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PREFACE 


This  document  presents  an  analysis  of  the  results  of  an  advanced  technology 
demonstration  of  five  vehicular-mounted  mine  detection  systems  developed  for  the  detec¬ 
tion  of  antitank  land  mines.  Three  of  the  systems,  built  by  EG&G,  Inc.;  GDE  Systems, 
Inc.,  and  Geo-Centers,  Inc.,  were  developed  for  the  U.S.  Army  Night  Vision  and  Elec¬ 
tronic  Sensors  Directorate.  Two  systems,  built  by  Coleman  Research  Corporation  and 
Computing  Devices  Canada,  participated  in  this  demonstration  through  funds  from  the 
Project  Manager,  Mines,  Countermine,  and  Demolition.  (Computing  Devices  Canada 
built  its  system  for  the  Canadian  Forces  through  the  Defence  Research  Establishment 
Suffield.)  The  advanced  technology  demonstration  took  place  at  the  Aberdeen  Test 
Center,  Aberdeen,  Maryland,  on  June  8-19,  1998,  and  the  Energetic  Materials  Research 
and  Testing  Center,  Socorro,  New  Mexico,  on  July  13-24,  1998. 

This  document  was  prepared  for  the  Director  of  Defense  Research  and  Engineer¬ 
ing,  Office  of  the  Under  Secretary  of  Defense  (Acquisition  and  Technology),  under  a  task 
titled,  “Technical  Support  to  Communication  and  Electronics  Command  Night  Vision 
and  Electronic  Systems  Directorate  Mine  Detection  Program.” 
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EXECUTIVE  SUMMARY 


BACKGROUND 

This  report  summarizes  the  results  of  an  Advanced  Technology  Demonstration 
(ATD)  of  five  vehicular-mounted  mine  detection  (VMMD)  systems  developed  for  detec¬ 
tion  of  antitank  landmines.  Three  of  the  systems,  built  by  EG&G,  Inc.;  GDE  Systems, 
Inc.,  and  Geo-Centers,  Inc.,  were  developed  for  the  U.S.  Army  Night  Vision  and  Elec¬ 
tronic  Sensors  Directorate.  Two  systems,  built  by  Coleman  Research  Corporation  and 
Computing  Devices  Canada,  participated  in  this  demonstration  through  funds  from  the 
Project  Manager,  Mines,  Countermine,  and  Demolition.  (Computing  Devices  Canada 
built  its  system  for  the  Canadian  Forces  through  the  Defence  Research  Establishment 
Suffield.)  The  demonstration  took  place  at  two  locations:  the  Aberdeen  Test  Center, 
Aberdeen,  Maryland,  on  June  8-19,  1998,  and  the  Energetic  Materials  Research  and 
Testing  Center,  Socorro,  New  Mexico,  on  July  13-24,  1998. 

The  purpose  of  the  VMMD  program  is  to  develop  and  demonstrate  technology 
needed  to  produce  a  remotely  operated  vehicle  that  will  detect  and  mark  antitank  land¬ 
mines  during  military  mine  clearance  operations.  The  system  will  ultimately  consist  of  a 
mine  overpass  vehicle  upon  which  is  mounted  a  sensor  system  to  detect  mines  and  a 
communication  system  that  provides  for  data  transfer  between  the  detection  vehicle  and 
the  remote  operator. 

DEMONSTRATION  DESCRIPTION 

All  five  contractors’  sensor  suites  included  ground-penetrating  radar  (GPR)  and 
electromagnetic  induction  (EMI)  sensors.  Four  of  the  five  contractors  (Computing 
Devices  Canada,  EG&G,  GDE,  and  GeoCenters)  also  used  infrared  (IR)  sensors. 
(Coleman’s  sensor  suite  did  include  IR,  but  it  was  not  used  in  this  ATD.)  In  general, 
contractors  used  automatic  target  recognition  (ATR)  algorithms  to  analyze  their  sensor 
data;  however,  Computing  Devices  Canada  and  Geo-Centers  used  a  man-in-the-loop  to 
evaluate  IR  images  in  real  time.  Four  of  the  five  contractors  (Coleman  ,  EG&G,  GDE, 
and  GeoCenters)  mounted  their  systems  on  high-mobility  multipurpose  wheeled  vehicles 
(HMMWVs);  Computing  Devices  Canada  used  a  remote-controlled  detection  vehicle. 
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The  antitank  mine  threats  that  these  systems  will  ultimately  encounter  include 
metal-cased  mines  and  mines  with  low-metal  content  (these  mines  have  plastic  cases  but 
do  have  a  small  amount  of  metal  in  their  internal  mechanisms).  These  mines  may  be  laid 
on  ground  surface  or  underground,  and  they  may  be  located  on  road  beds  or  in  off-road 
conditions.  All  these  variables  were  incorporated  in  this  demonstration. 

The  systems  were  tested  on  3-m-wide  test  lanes.  The  Aberdeen  test  included 
3,185  m2  of  on-road  lanes  and  1,140  m2  of  off-road  lanes.  The  Socorro  test  included 
3,090  m2  of  on-road  lanes  and  269  m2  of  off-road  lanes. 

There  were  about  equal  numbers  of  metal  and  low-metal  mines,  and  combined 
these  comprised  about  95  percent  of  the  mine  types  in  this  test  (the  remaining  5  percent 
being  nonmetal  mine  surrogates).  About  40  percent  of  the  mines  were  emplaced  on  the 
surface;  the  balance  were  buried  at  depths  ranging  from  1 .5  to  4  in.  below  the  surface. 

MEASURING  PERFORMANCE 

To  score  performance,  contractor  declarations  were  matched  to  mines  on  the  basis 
of  a  separation  distance,  Rhalo,  between  the  edge  of  a  mine  and  the  location  of  a  con¬ 
tractor’s  declaration.  Rhalo  was  taken  to  be  1  m,  as  directed  in  the  Operational  Require¬ 
ments  Document  for  this  program.  If  more  than  one  declaration  was  within  Rhalo  of  a  mine, 
the  contractor  was  credited  with  a  single  detection  (the  closest  one  to  the  mine),  and  the 
others  were  ignored.  If  a  contractor’s  declaration  did  not  fall  within  i?hal0  of  any  mine,  it 
was  considered  a  false  alarm. 

SYSTEM  PERFORMANCE 

Tables  ES-1  and  ES-2  provide  a  summary  of  the  on-road  and  off-road  per¬ 
formances,  respectively,  of  each  contractor  in  the  demonstration.  False-alarm  rates  {FAR, 
in  units  m'2)  are  listed,  as  are  detection  probabilities  (PJ  for  surface  and  subsurface  mines 
at  Aberdeen  and  Socorro.  Also  given  are  the  exit  criteria  that  should  be  met  at  this 
demonstration  in  order  to  justify  proceeding  to  the  next  phase  of  this  program. 

CONCLUSIONS 

As  can  be  seen  in  Tables  ES-1  and  ES-2,  the  exit  criteria  were  typically  met  by  a 
majority  of  contractors  at  each  test  site,  except  the  on-road  FAR  at  Aberdeen  (met  by  only 
one  contractor),  and  the  off-road,  subsurface  Pd  at  Socorro  (again,  met  by  one  contractor). 


ES-2 


Reduction  of  the  FAR  is  one  of  the  serious  challenges  for  this  program,  as  the 
ultimate  requirements  on  FAR  (described  in  the  Operational  Requirements  Document)  are 
substantially  below  those  achieved  in  this  demonstration. 

Other  conclusions,  which  are  substantiated  in  this  report,  are  listed  here: 

•  The  contractors’  GPR  sensors  were,  overall,  the  most  effective  sensors  for 
the  detection  of  AT  mines.  The  GPRs  also,  generally,  contributed  the  most 
false  alarms  of  the  three  sensor  types. 

•  Subsurface,  low-metal  mines  in  off-road  conditions  seemed  to  be  the  most 
difficult  mines  to  detect  in  this  ATD. 

•  Metal  cased  AT  mines  were  detected  with  a  high  probability  by  the  VMMD 
systems  discussed  herein.  Both  GPR  and  EMI  sensors  were  effective  at 
finding  these  mines  at  the  depths  tested  in  this  ATD. 

•  Surface  mines  were  also  shown  to  be  detectable  with  a  high  probability  in 
this  series  of  tests.  Both  GPR  and  IR  systems  were  effective,  regardless  of  the 
metal  content  of  the  mine. 

•  The  along-track  and  cross-track  position  resolutions  typically  achieved  in  this 
series  of  tests  suggest  that  the  mine  halo  can  be  reduced  from  1  m  without 
eliminating  real  detections. 


Table  ES-1.  Summary  of  On-Road  Performance  at  Aberdeen  and  Socorro 


Contractor 

FAR 

(exit  criterion 
<0.042  m ■*) 

Subsurface  Pd 
(exit  criterion 
>  0.85) 

Surface  Pd 
(exit  criterion 
>  0.90) 

Aberdeen 

Socorro 

Aberdeen 

Socorro 

Aberdeen 

Socorro 

Computing  Devices 
Canada 

0.054 

0.032 

0.93 

0.89 

1.0 

1.0 

Coleman  Research 
Corp. 

0.034 

0.037 

0.77 

0.91 

0.92 

1.0 

EG&G,  Inc. 

0.081 

0.043 

0.93 

0.92 

1.0 

0.97 

GDE  Systems 

0.068 

0.037 

0.91 

0.90 

0.97 

1.0 

GeoCenters,  Inc. 

0.056 

0.032 

0.99 

0.91 

1.0 

1.0 
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Table  ES-2.  Summary  of  Off-Road  Performance  at  Aberdeen  and  Socorro 


Contractor 

FAR 

(exit  criterion 
<0.17  m  2) 

Subsurface  Pd 
(exit  criterion 
>0.80) 

Surface  Pd 
(exit  criterion 
>  0.90) 

Aberdeen 

Socorro 

Aberdeen 

Socorro 

Aberdeen 

Socorro 

Computing  Devices 
Canada 

0.050 

0.048 

0.99 

0.63 

1.0 

1.0 

Coleman  Research 
Corp. 

0.201 

0.91 

0.73 

0.96 

1.0 

EG&G,  Inc. 

0.099 

0.058 

0.96 

0.70 

0.96 

1.0 

GDE  Systems 

0.085 

0.065 

0.91 

0.80 

0.94 

1.0 

GeoCenters,  Inc. 

0.066 

0.035 

0.90 

0.70 

1.0 

1.0 
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I.  INTRODUCTION 


A.  BACKGROUND  OF  THE  ADVANCED  TECHNOLOGY 
DEMONSTRATION 

This  report  summarizes  the  results  of  an  Advanced  Technology  Demonstration 
(ATD)  of  five  Vehicular  Mounted  Mine  Detection  (VMMD)  systems  developed  for  the 
detection  of  antitank  (AT)  landmines.  Three  of  the  systems,  built  by  EG&G,  Inc.;  GDE 
Systems,  Inc.,  and  Geo-Centers,  Inc.,  were  developed  for  the  U.S.  Army  Night  Vision 
and  Electronic  Sensors  Directorate.  Two  systems,  built  by  Coleman  Research  Corpora¬ 
tion  and  Computing  Devices  Canada,  participated  in  this  demonstration  through  funds 
from  the  Project  Manager,  Mines,  Countermine,  and  Demolition.  (Computing  Devices 
Canada  built  its  system  for  the  Canadian  Forces  through  the  Defence  Research  Establish¬ 
ment  Suffield.)  The  ATD  took  place  at  the  Aberdeen  Test  Center  (ATC),  Aberdeen, 
Maryland,  on  June  8-19,  1998,  and  the  Energetic  Materials  Research  and  Testing  Center, 
Socorro,  New  Mexico,  on  July  13-24,  1998. 

B.  MOTIVATION  AND  OBJECTIVES  OF  THE  ATD 

During  combat,  when  timely  maneuvers  are  critical,  countermine  engineers  use 
plows,  rollers,  and  explosives  to  breach  minefields.  These  breaching  devices,  designed  to 
rapidly  cut  well-defined  paths  through  mined  areas,  are  not  appropriate  for  clearing  large 
tracts  of  land  or  extended  lengths  of  road  for  unrestricted  use.  Instead,  wide-area  clear¬ 
ance  of  mines  must  be  performed  in  two  stages,  first  by  detecting  the  mines  and  then  by 
removing  the  mines  or  destroying  them  in  place.  Currently,  mines  are  detected  visually, 
through  physical  contact  (probing),  or  by  using  hand-held  mine  detection  systems, 
specifically  the  AN/PSS-12  pulsed  induction  metal  detector.  These  techniques  are  time 
consuming,  hazardous,  and  can  be  unreliable.  Consequently,  the  Army  Science  and 
Technology  Working  Group  approved  the  development  of  a  VMMD  system  that  can 
rapidly,  safely,  and  reliably  detect  mines.  Such  a  system  could  also  be  used  to  detect  the 
leading  edge  of  a  minefield,  even  if  plows,  rollers,  or  explosives  would  ultimately  be 
used  to  breach  the  field. 
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The  purpose  of  the  program  is  to  develop  and  demonstrate  the  technology  needed 
to  produce  a  remotely  operated  vehicle  that  will  detect  mines  and  mark  their  locations 
during  military  mine  clearance  operations.  The  system  will  ultimately  consist  of  a  mine 
overpass  vehicle  upon  which  is  mounted  a  sensor  system  that  detects  mines,  a  marking 
system  to  designate  detection  locations,  and  a  communication  system  that  provides  data 
transfer  between  the  detection  vehicle  and  the  remote  operator.  The  system  will  be  called 
the  Ground  Standoff  Mine  Detection  System  (GSTAMIDS). 

The  mine  threats  that  GSTAMIDS  will  encounter  include  metal-cased  mines  and 
mines  with  low-metal  content  (these  mines  have  plastic  cases  but  do  have  a  small  amount 
of  metal  in  their  internal  mechanisms).  These  mines  may  be  laid  on  ground  surface  or 
buried  underground. 

The  final  system  requirements  are  published  in  the  GSTAMIDS  Operational 
Requirements  Document  (ORD,  1996).  ATD  criteria  were  written  by  the  Army  Science 
and  Technology  Working  Group  (ASTWG)  and  adopted  by  TECOM  (1996).  Separate 
criteria  exist  for  the  transition  from  the  ATD  to  the  Engineering  Manufacturing  Develop¬ 
ment  (EMD)  phase  in  the  VMMD  development.1  The  EMD  criteria  constitute  the  most 
relevant  criteria  forjudging  the  performance  of  the  contractors  in  this  ATD,  and  are  thus 
referred  to  as  the  ATD’s  exit  criteria  in  the  remainder  of  this  report. 

The  ORD  requirements,  TECOM  requirements,  and  EMD  criteria  (exit  criteria) 
are  summarized  in  Table  1-1.  Further  details  regarding  the  VMMD  requirements  can  be 
found  in  the  references. 

C.  VMMD  TECHNOLOGY 

VMMD  systems  should  aim  to  speed  up  the  forward  progress  of  troops  (as  com¬ 
pared  with  current  mine  detection  methods).  Important  characteristics  of  such  a  system 
include  accuracy  of  location,  high  probability  of  mine  detection,  and  a  low  probability  of 
false  alarms.  The  sensor  suites  from  each  of  the  contractors  use  a  combination  of 
relatively  mature  technologies  and  advanced  automatic  target  recognition  (ATR)  algor¬ 
ithms  to  achieve  these  goals.  Technologies  used  by  all  of  the  five  contractors  include 
ground-penetrating  radar  (GPR),  an  infrared  (IR)  and/or  optical  system,  and  a  pulsed 
electromagnetic  induction  (EMI)  metal-detection  system.  One  contractor’s  sensor  suite 
contains  a  thermal  neutron  analysis  (TNA)  sensor,  used  to  confirm  the  presence  of 


1  Ground  Standoff  Minefield  Detection  System  Milestone  I:  Program  Initiation  Milestone  Decision 
Review,  Office  of  the  Program  Manager  for  Mines,  Countermine,  and  Demolitions,  July  1997. 
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explosives.  All  contractors  collect  and  analyze  the  data  from  each  of  their  sensors.  Data 
processing  is  done  in  real  time  so  that  the  operators  can  be  notified  about  mine  encoun¬ 
ters  as  soon  as  they  occur. 


Table  1-1.  Summary  of  Exit  Criteria  of  the  VMMD  System 


Operation 

Characteristic 

GSTAMIDS  ORD 

TECOM  Criteria 

ATD  Exit  Criteria 

Off-Road 

Minimum 

(Goal) 

On-Road 

Minimum 

(Goal) 

Off-Road 

Minimum 

(Goal) 

On-Road 

Minimum 

(Goal) 

Off-Road 

Minimum 

On-Road 

Minimum 

Detection  Speed  (km/h) 

7.2  (12)a 

1 5  (25)a 

2(3) 

3.6  (5) 

2 

3.6 

Minimum  Standoff 
Distance  (m) 

1  (5)b 

1  (5)b 

1 

1 

Not 

specified 

Not 

specified 

Detector  Swath  (m) 

2.5 

2.5 

3.0 

3.0 

3.0 

3.0 

Detection  Probability 

(Pd)  (%) 

Surface  AT  mines 
Buried  AT  mines 

90(100) 

80  (95) 

90  (100) 

90  (100) 

92  (98) 

90  (95) 

95  (99) 

92  (95) 

90 

80 

90 

85 

Maximum  False  Alarm 
Rate  (FAR)  (per 
squared  meter)0 

0.010 

(0.007) 

0.005 

(0.002) 

0.083 

(0.05) 

0.020 

(0.013) 

0.17 

0.042 

Marking  accuracy/halo 
size  (m) 

1.0  (0.5) 

1 .0  (0.5) 

1.0  (0.5) 

1.0  (0.5) 

1.0 

1.0 

a  These  are  alert  rates:  the  GSTAMIDS  ORD  states  that  the  vehicles  may  slow  down  to  an  unspecified  speed  for 
landmine  verification. 


b  Verification  distance. 

c  The  GSTAMIDS  ORD  and  ATD  exit  criteria  quote  these  numbers  in  units  of  number  per  meter  of  forward  progress. 
All  test  lanes  in  this  ATD  were  3  m  wide,  so  the  equivalent  FAR  per  squared  meter  shown  here  is  simply  the  exit 
criteria  divided  by  3. 

CRC,  EG&G,  GDE,  and  GeoC  mounted  their  sensors  on  a  high-mobility  multi¬ 
purpose  wheeled  vehicle  (HMMWV)  for  this  ATD;  CDC’s  sensors  were  mounted  on  a 
remote-controlled  detection  vehicle  (RDV).  Features  common  to  each  system  include  the 
following: 


•  Three-meter  wide  detection  coverage 

•  Integrated  differential  Global  Positioning  System  (dGPS) 

•  Electronic  marking  of  detections  (geolocations) 

•  ATR  Algorithms. 

Tables  1-2  through  1-5  summarize  the  characteristics  of  the  different  sensors. 

Individual  contractors  used  their  sensor  suites  in  different  ways.  In  general,  CDC 
and  EG&G  used  all  three  detection  sensors  (the  GPR,  EMI,  and  IR  sensors)  at  both 
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Table  1-2.  GPR  Characteristics 


Contractor 

Type 

BW 

(GHz) 

Pulse 

Width 

Antenna 

Coherent 

Comments 

Impulse 

0.5-5 

300  psec 

Bistatic  Split  Pair 
(Parabolic) 

No 

45%  look  ahead, 
vertical  polarization 

GeoCenters 

Impulse 

0.7-1 .3 

1  nsec 

Transverse  EM 
(Rhombus) 

N/A 

Patented  energy- 
focused  GPR 

GDE 

Swept 

Frequency 

0.5-2. 1 

200  steps 

Zigalog  PCB 

Yes 

Coleman 

Swept 

Frequency 

1-3 

90  steps 

Spiral 

Yes 

CDC 

All  Specifications  Proprietary 

Mfr.  IAI-ELTA 

Table  1-3.  Optical  Characteristics 


Contractor 

Band  (pm) 

Manufacturer* 

NEAT 

EG&G 

3-5,  8-12,  Visible 

Mitsubishi,  FLIR,  Cohu 

0.06  K,  0.08  K,  N/A 

GeoCenters 

3-5 

Amber/Raytheon 

0.0025  K 

GDE 

8-12 

Agema 

<0.1  K 

Coleman 

3-5,  8-12 

FLIR 

0.003  K 

CDC 

8-12 

Agema  (THV-1000) 

MRT  <0.1  K 

*  Agema  and  FLIR  Systems,  Inc.,  merged  recently,  but  at  the  time  these  systems  were  purchased,  these  two 


companies  were  separate. 


Table  1-4.  Pulsed  EMI  Characteristics 


Contractor 

PW/Frequency 

#  Coils 

Coil  Size 
(m) 

Manufacturer 

Comment 

EG&G 

30  psec 

9 

0.3  x  0.45 

EG&G 

Dual  Orthogonal 
Illumination 

GeoCenters 

5  msec/75  Hz 

6 

0.5 

Geonics 

GDE 

— 

6 

0.5 

Vallon 

Coleman 

70  Hz 

6 

0.27 

Schiebel 

6AN/PSS-12s 

CDC 

— 

24 

0.25 

Schiebel 

VAMIDS 

Table  1-5.  Confirmation  Sensor  Characteristics 


Contractor 

Type 

Responds  to 

Comment 

CDC 

Thermal  Neutron  Analysis 

Nitrogen  Content 

SAIC  Canada  Minescans 

Aberdeen  and  Socorro.  CRC  used  only  the  GPR  and  EMI  sensors  during  this  ATD.  GDE 
and  GeoC  used  their  GPR  and  EMI  sensors  at  all  times,  but  the  IR  sensors  were  used 
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selectively.  GeoC  used  the  IR  sensor  almost  exclusively  for  surface  mine  detection;  GDE 
always  used  the  IR  sensor  during  the  Socorro  test,  but  not  always  at  Aberdeen.  CDC,  the 
only  contractor  to  have  a  confirmation  sensor  (TNA),  used  the  TNA  sensor  selectively. 
See  Appendix  A  for  details  of  each  contractor’s  use  of  its  sensor  suites. 

Although  each  contractor  used  ATR  algorithms  to  analyze  GPR  and  EMI  sensor 
data,  not  all  contractors  used  ATR  to  evaluate  IR  data.  In  particular,  CDC  had  no  ATR 
algorithm  and  used  a  man-in-the-loop  to  evaluate  the  IR  images  in  real  time.  GeoC  did 
have  an  ATR,  but  primarily  used  a  man-in-the-loop  to  evaluate  IR  images  during  this 
ATD.  EG&G  and  GDE  both  used  ATR  exclusively  for  IR  data  analysis. 

Each  contractor’s  GPR  sensor  had  an  above-ground  distance  of  about  0.3  to  0.5  m 
(and  in  some  cases,  greater  than  0.5  m).  CRC,  EG&G,  GDE,  and  GeoC  had  their  EMI 
sensors  at  a  relatively  large  above-ground  distance  (>0.5  m)  and  did  not  raise  or  lower 
them  during  operation.  CDC’s  EMI  sensor  had  a  variable  above-ground  distance  which 
could  be  as  little  as  a  few  centimeters,  because  this  sensor  was  used  to  detect  low-metal 
as  well  as  metal-cased  mines.  As  a  result,  CDC’s  metal  detector  had  to  be  raised  when 
surface  landmines  were  encountered.  All  contractors’  IR  systems  were  mounted  atop 
their  vehicles  and  had  a  large  standoff  distance  (>2  m).  CDC’s  confirmation  (TNA) 
system  normally  rode  high  above  the  ground  but  was  lowered  to  within  centimeters  of  the 
ground  for  ~2-3  minutes  during  target  confirmation. 

All  contractors  incorporated  electronic-  and  physical-marking  systems.  The 
physical-marking  systems  varied: 

•  CDC’s  marks  were  made  with  a  water-based  gel; 

•  CRC’s  were  made  by  depositing  2.5-in.  diameter  disks  from  10  equally 
spaced  dispensers  across  the  vehicle; 

•  EG&G’s  marks  were  made  with  chalk  deposited  by  32  elements  spaced  at 
4-in.  intervals  across  the  front  bumper  of  the  vehicle; 

•  GDE  sprayed  4-in.  by  4-in.  paint  marks  using  several  solenoids  located 
across  the  vehicle;  and 

•  GeoC  sprayed  a  water-based  paint  from  a  series  of  nozzles  spaced  at  6-in. 
intervals  across  the  vehicle. 

D.  ORGANIZATION  OF  THIS  REPORT 

This  report  is  structured  as  follows. 
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•  Chapter  II  contains  a  description  of  the  ATD,  including  details  on  the  test 
lanes  at  Socorro  and  Aberdeen,  and  the  mine  types  and  disposition  used  at 
each  site. 

•  Chapter  III  defines  the  measures  of  performance,  notably  detection  probabil¬ 
ity  (PJ,  false-alarm  rate  (FAR),  probability  of  false  alarm  (P/a),  and  position 
resolution  of  the  sensors. 

•  Chapter  IV  compares  the  performance  of  the  contractors  at  each  test  site,  as 
well  as  combined  data  from  both  sites,  on-  and  off-road,  for  detecting  surface 
and  subsurface  mines.  It  also  compares  position  accuracy  and  average  vehicle 
speed  during  the  tests. 

•  Chapter  V  gives  the  details  of  each  contractor  at  both  test  sites  for  individual 
sensors,  sensor  pairs,  and  the  complete  system.  The  section  provides  details 
of  the  contractors’  effectiveness  at  detecting  metal,  low-metal,  and  nonmetal 
mines.  It  also  evaluates  position  resolution,  as  well  as  the  contractors’  per¬ 
formance  during  special  (additional)  runs. 

•  Chapter  VI  contains  conclusions. 

•  Appendix  A  contains  an  in-depth  description  of  the  contractors’  systems. 

•  Appendix  B  contains  a  lane-by-lane  catalog  of  the  mines  detected  and  missed 
during  each  run. 

•  Appendix  C  contains  comprehensive  summaries  of  the  contractors’  perfor¬ 
mance  for  surface  and  subsurface  mines  in  on-road  and  off-road  consitions, 
as  well  as  for  special  runs.  Results  are  categorized  by  sensor  type  as  well  as 
by  metal  content  of  the  mines. 
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II.  TEST  DESCRIPTION 


A.  ATC  TEST  LANES 

VMMD  technologies  were  tested  in  two  road  environments,  each  including  one  or 
more  calibration  and  test  lanes: 

A.  On-road.  Mines  were  buried  in  three  calibration  lanes  and  three  test  lanes 
consisting  of  dirt  with  gravel  scattered  throughout.  The  test  lanes  were  3.0  m 
wide  and  varied  in  length  from  about  3 15  m  to  380  m.  The  lanes  were  oriented 
in  approximately  the  east-west  direction.  The  total  area  covered  by  the  on¬ 
road  lanes  was  3,1 84.6  m2. 

B.  Off-road.  Mines  were  buried  in  two  calibration  lanes  and  two  test  lanes 
consisting  of  natural  dirt  covered  by  grass.  The  length  of  each  test  lane  was 
190  m  and  the  width  of  each  lane  was  3  m.  The  number  of  mines  emplaced  in 
each  test  lane  was  29.  The  off-road  lanes  were  aligned  parallel  to  one  another 
in  approximately  the  east- west  direction  and  separated  by  about  10  m.  The 
total  area  covered  by  the  off-road  test  lanes  was  1,140.3  m2. 

To  avoid  ambiguity  in  detection  determination,  the  mine  density  was  chosen  to 
ensure  that  the  areas  encompassing  the  mines  did  not  overlap.2  The  mines  are  classified 
by  their  metal  content:  “metal”  refers  to  mines  with  metal  cases,  “low  metal”  refers  to 
mines  with  nonmetallic  cases  that  contain  some  metal  parts  (generally  in  the  fuzing  or 
firing  mechanism),  and  “nonmetal”  refers  to  surrogate  mines  with  no  metal  content. 
These  will  be  denoted  by  M,  LM,  and  NM,  respectively,  in  this  report.  In  all  mines,  the 
detonators  were  made  safe,  usually  by  removing  part  of  the  firing  pin  or  striker 
mechanism;  in  some  cases  the  booster  charge  was  removed.  To  ensure  accurate  metal 
content  in  the  low-metallic  mines,  any  metal  removed  was  replaced  with  an  equivalent 
amount  of  metallic  surrogate.  Mines  were  emplaced  both  on  the  surface  and  at  several 
depths  below  the  surface  ranging  from  1  to  4  in.  Depth  was  measured  from  the  ground’s 
surface  to  the  upper-most  part  of  the  mines.  To  ensure  accurate  ground  truth  for 
comparison  to  demonstrator  declarations  of  potential  target  locations,  the  positions  of  the 


2  For  circular  mines,  the  area  encompassing  a  mine  is  defined  as  the  area  inside  a  circle  of  radius 
rm  +  halo,  centered  about  the  mine.  rm  is  the  radius  of  the  mine,  and  halo  refers  to  the  radius  added  to 
the  outside  edge  of  a  mine  for  determining  matches  to  sensor  declarations  (see  Figure  III-l). 


mines  were  surveyed  after  the  mines  were  placed  in  the  holes  but  before  the  holes  were 
filled.  It  should  be  noted  that  there  is  some  evidence  that  the  metallic  clutter  at  the 
Aberdeen  site  is  worse  than  at  the  Socorro  site  (Socorro  is  discussed  later  in  this  chapter). 
The  evidence  comes  from  data  collected  by  the  AN/PSS— 12  of  each  site.  The  AN/PSS— 12 
contains  a  sensitivity  knob  which  operators  periodically  adjust,  so  a  direct  comparison  of 
the  sites  is  difficult.  However,  many  more  metallic  alarms  were  collected  at  Aberdeen 
than  at  Socorro. 

1.  Mines  Emplaced  in  On-Road  Test  Lanes  at  Aberdeen 

The  VMMD  technologies  were  tested  on  three  on-road  lanes  at  Aberdeen.  On¬ 
road  calibration  lanes  were  made  available  to  the  demonstrators  before  testing.  Each  of 
the  on-road  calibration  lanes  contained  a  mix  of  mines  that  closely  matched  the  charac¬ 
teristics  (type,  burial  depth)  of  the  mines  that  would  be  encountered  in  the  test  lane. 
Because  the  test  lanes  were  located  within  10  to  40  m  of  each  other,  there  was  system 
interference  between  contractors  when  testing  on  adjacent  lanes.  This  interference 
problem  was  overcome  by  requiring  contractors  to  test  one  after  the  other. 

Table  II- 1  lists  the  number,  metal  content,  and  diameter  of  the  type  of  AT  mines 
emplaced  in  each  on-road  test  lane  at  Aberdeen.  Also  given  are  the  totals  by  lane  and 
mine  type,  as  well  as  the  length  and  mine  density  of  each  lane.  Note  that  all  the  mines  are 
approximately  the  same  size,  as  indicated  by  their  diameter.  The  diameter  difference 
between  the  smallest  mine  (the  TMA4  with  diameter  of  0.280  m)  and  the  largest  mine 
(the  Ml 5  with  diameter  of  0.337  m)  is  only  0.057  m. 

The  difference  between  the  Ml 5  and  Ml 51  mines  is  related  to  the  explosive 
content  of  the  mine.  The  Ml  51  is  a  metal-cased  mine  containing  a  surrogate  to  the 
explosive  that  is  normally  found  in  an  Ml  5  mine.  It  is  thus  inert,  denoted  by  the  “I”  in  its 
name.  The  same  explosive  content  differences  are  found  in  the  Ml 9  and  Ml 91  mines,  and 
the  TM62M  and  TM62MI  mines.  The  only  nonmetal  mine  is  the  EM  12,  which  is  a 
surrogate  in  the  sense  that  it  is  designed  to  look  like  a  mine  and  be  detected  as  a  mine. 
There  is  little  variation  between  the  total  number  of  mines,  lane  length,  and  mine  density 
for  each  of  the  three  on-road  test  lanes.  If  the  inert  mines  are  grouped  with  their  non-inert 
counterparts,  then  the  Ml 9  (and  Ml 91)  appears  the  most  at  24  over  the  three  lanes,  while 
the  EM  12  and  TM46  appear  the  fewest  number  of  times,  at  6. 
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Table  11-1.  Mines  Emplaced  in  On-Road  Lanes  at  Aberdeen 


Name 

Metal 

Content 

Diameter 

(m) 

Lane 

11 

Lane 

12 

Lane 

15 

Totals 

EM12a 

NM 

0.3048 

2 

2 

2 

6 

M15 

M 

0.3370 

4 

3 

5 

12 

M15I 

M 

0.3370 

3 

4 

2 

9 

M19b 

LM 

0.3320 

4 

5 

3 

12 

M19lb 

LM 

0.3320 

4 

3 

5 

TM46 

M 

0.3050 

2 

2 

2 

6 

TM62M 

M 

0.3200 

2 

2 

0 

4 

TM62MI 

M 

0.3200 

6 

6 

6 

18 

TM62P 

0.3200 

5 

5 

5 

15 

TMA4 

| 

5 

5 

5 

15  | 

Total 

37 

37 

35 

109 

Lane  Length  (m) 

315.1 

380.0 

366.1 

1061.2 

Mines  per  meter  of  road 

0.117 

0.097 

0.096 

0.103 

a  These  are  plastic  surrogates. 

b  The  Ml  9  and  Ml  91  are  square  mines  of  width  0.3320  m. 


Table  II-2  shows  the  distribution  of  mines  for  on-road  test  lanes  by  their  metal 
content  and  their  emplaced  depth.  Due  to  rounding,  percentages  do  not  always  add  up  to 
100  percent.  For  each  of  the  three  on-road  test  lanes,  the  number  of  metal  and  low-metal 
mines  are  nearly  the  same,  and  comprise  approximately  95  percent  of  the  total  mines. 
Only  two  nonmetal  mines  were  used  in  each  of  the  on-road  test  lanes.  The  depth  distribu¬ 
tion  of  mines  in  each  on-road  test  lane  was  nearly  the  same.  Approximately  40  percent  of 
the  mines  were  located  on  the  surface.  The  remaining  60  percent  of  the  mines  were 
buried,  most  at  the  1.5-in.  and  2-in.  depths.  Only  about  15  percent  of  the  mines  were 
buried  more  deeply  than  2  in. 

Table  II-3  shows,  for  a  given  burial  depth,  the  percentage  of  metal,  low-metal, 
and  nonmetal  mines  on  the  combined  on-road  test  lanes.  We  observe  three  notable  trends. 
First,  only  one  type  of  metal  mine  was  buried  at  4  in.,  the  TM62M  (and  TM62MI). 
Second,  only  the  low-metal  TM62P  mine  was  buried  at  3  in.  Third,  the  only  nonmetal 
mine  in  the  baseline,  the  EM  12,  appeared  on  the  surface  or  at  a  burial  depth  of  2  in. 
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Table  11-2.  Mine  Types  and  Depths  for  On-Road  Lanes  at  Aberdeen 


Lane  1 1 

Lane  12 

Lane  15 

Totals 

Total  Number  Emplaced 

37 

37 

35 

109 

Metal  Content 

M 

17(46%) 

17(46%) 

15  (43%) 

49  (45%) 

LM 

18(49%) 

18  (49%) 

18  (51%) 

54  (50%) 

NM 

2  (5%) 

2  (5%) 

2  (6%) 

6  (6%) 

Depth 

Surface 

14(38%) 

14  (38%) 

15(43%) 

43  (39%) 

1.5  in. 

7  (19%) 

7(19%) 

7  (20%) 

21  (19%) 

2  in. 

10(27%) 

10  (27%) 

8  (23%) 

28  (26%) 

3  in. 

3  (8%) 

3  (8%) 

3  (9%) 

9  (8%) 

4  in. 

3  (8%) 

3  (8%) 

2  (6%) 

8  (7%) 

Table  11-3.  Mine  Depths  and  Metal  Content  for  On-Road  Lanes  at  Aberdeen 


Metal 

Low  Metal 

Nonmetal 

Totals 

Total  Number  Emplaced 

49 

54 

6 

109 

Depth 

Surface 

18  (37%) 

22  (43%) 

3  (50%) 

43  (39%) 

1.5  in. 

12  (25%) 

9(17%) 

0  (0%) 

21  (19%) 

2  in. 

11  (22%) 

14  (26%) 

3  (50%) 

28  (26%) 

3  in. 

0  (0%) 

9  (17%) 

0  (0%) 

9  (8%) 

4  in. 

8(16%) 

0  (0%) 

0  (0%) 

8  (7%) 

2.  Mines  Emplaced  in  Off-Road  Test  Lanes  at  Aberdeen 

Table  II-4  lists  the  AT  mines  emplaced  in  the  two  off-road  test  lanes  at  Aberdeen. 
The  only  nonmetal  mine,  the  EM12,  was  not  emplaced  in  either  off-road  test  lane.  The 
Ml 5  (and  Ml 51)  appears  the  most  at  15  times,  while  the  TM46  appears  the  least  at  2 
times.  The  total  number  of  mines  emplaced  in  the  off-road  test  lanes  was  only  58, 
compared  to  109  for  the  on-road  test  lanes.  There  was  one  less  lane  than  for  the  on-road 
test  lanes,  and  each  lane  was  about  half  the  length  of  the  average  length  of  the  on-road 
test  lanes.  The  resultant  mine  density  for  both  off-road  test  lanes  was  0.153  m  ,  or 
approximately  50  percent  greater  than  the  on-road  test  lane  mine  densities. 

Table  II-5  shows  the  distribution  of  mines  for  the  off-road  test  lanes  by  metal 
content  and  emplaced  depth.  About  half  the  mines  were  metallic  while  the  other  half 
were  low  metal.  No  nonmetal  mines  were  used  on  the  off-road  lanes  at  Aberdeen.  Again, 
approximately  40  percent  of  the  mines  were  located  on  the  surface.  One  mine  in  lane  2 
was  emplaced  at  a  depth  of  1  in.  This  was  the  only  occurrence  of  a  mine  emplaced  at  this 
depth  at  Aberdeen  for  both  on-road  and  off-road  test  lanes.  Only  17  percent  of  the  mines 
were  buried  at  depths  greater  than  2  in.  As  with  the  on-road  test  lanes,  about  40  percent 
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of  the  mines  were  emplaced  at  depths  of  1.5  in.  and  2  in.,  but  more  mines  were  buried 
1.5  in.  deep  than  2  in.  deep.  For  the  on-road  test  lanes,  more  mines  were  buried  at  2  in. 
than  at  1.5  in.  (see  Table  II-3). 


Table  11-4.  Mines  Emplaced  in  Off-Road  Lanes  at  Aberdeen 


Name 

Metal 

Content 

Diameter 

(m) 

Lane 

2 

Lane 

4 

Totals 

EM12a 

NM 

0.3048 

0 

0 

0 

M15 

M 

0.3370 

6 

5 

11 

Ml  51 

M 

0.3370 

2 

2 

4 

Ml  9” 

LM 

0.3320 

4 

3 

7 

M19lb 

LM 

0.3320 

1 

3 

4 

TM46 

M 

0.3050 

1 

1 

2 

TM62M 

M 

0.3200 

4 

2 

6 

TM62MI 

M 

0.3200 

3 

5 

8 

TM62P 

0.3200 

4 

4 

8 

TMA4 

LM 

0.2800 

4 

4 

8 

Total 

29 

29 

58 

Lane  Length  (m) 

190.0 

190.1 

380.1 

Mines  per  meter  of  road 

0.153 

0.153 

0.153 

'  These  are  plastic  surrogates. 

*  The  Ml  9  and  Ml  91  are  square  mines  of  width  0.3320  m. 


Table  11-5.  Mine  Types  and  Depths  for  Off-Road  Lanes  at  Aberdeen 


Lane  2 

Lane  4 

Totals 

Total  Number  Emplaced 

29 

29 

58 

Metal  Content 

M 

16  (55%) 

15  (52%) 

31  (53%) 

LM 

13  (45%) 

14  (48%) 

27  (47%) 

NM 

0  (0%) 

0  (0%) 

0  (0%) 

Depth 

Surface 

12  (41%) 

12  (41%) 

24(41%) 

1  in. 

1  (3%) 

0  (0%) 

1  (2%) 

1.5  in. 

7  (24%) 

8  (28%) 

15(26%) 

2  in. 

4(14%) 

4  (14%) 

8  (14%) 

3  in. 

2  (7%) 

2  (7%) 

4  (7%) 

4  in. 

3(10%) 

3  (10%) 

6(10%) 

Table  II-6  shows  the  mine  distribution  for  the  off-road  test  lanes  at  Aberdeen  by 
depth  and  metal  content.  No  nonmetal  mines  were  emplaced  in  the  off-road  test  lanes  at 


II-5 


Aberdeen.  As  with  the  on-road  test  lanes,  the  metal  TM62M  (and  TM62MI)  mine  was  the 
only  mine  found  at  a  depth  of  4  in.,  and  the  low-metal  TM62P  mine  was  the  only  mine 
buried  at  3  in.  (depths  were  chosen  to  be  consistent  with  doctrine  for  each  mine  model). 

Table  11-6.  Mine  Depths  and  Metal  Content  for  Off-Road  Lanes  at  Aberdeen 


Metal 

Low  Metal 

Totals 

Total  Number  Emplaced 

31 

27 

58 

Depth 

Surface 

12(39%) 

12  (44%) 

24  (41%) 

1  in. 

1  (3%) 

0  (0%) 

1  (2%) 

1.5  in. 

8  (26%) 

7  (26%) 

15(26%) 

2  in. 

4(13%) 

4(15%) 

8  (14%) 

3  in. 

0  (0%) 

4(15%) 

4  (7%) 

4  in. 

6(19%) 

0  (0%) 

6  (10%) 

B.  SOCORRO  TEST  LANES 

VMMD  technologies  were  tested  in  two  road  environments  each  including  one  or 
more  calibration  and  test  lanes: 

•  On-road.  Mines  were  buried  in  seven  calibration  and  seven  test  lanes 
consisting  of  dirt  with  rocks  scattered  throughout.  The  on-road  test  lanes 
were  prepared  by  removing,  replacing,  and  compacting  the  soil  in  the  road¬ 
bed.  The  test  lanes  were  approximately  80  to  190  m  long  and  3  m  wide.  Lane 
orientation  varied  over  the  site.  The  total  area  covered  by  the  on-road  lanes 
was  3,090  m2. 

•  Off-road.  Mines  were  buried  in  one  calibration  lane  and  one  test  lane 
consisting  of  an  unprepared  dirt  road.  The  test  lane  was  89.6  m  long  and  3  m 
wide.  The  number  of  mines  emplaced  in  the  off-road  test  lane  was  24.  The 
total  area  covered  by  the  off-road  test  lane  was  268.8  m2. 

Unlike  Aberdeen,  the  calibration  and  test  lanes  were  located  in  four  geographi¬ 
cally  distinct  areas.  The  four  areas  were  separated  by  no  less  than  50  m.  Test  lane  1  was 
located  in  area  A.  Test  lanes  4  and  6  were  located  in  area  B.  Test  lane  8  was  located  in 
area  C,  and  test  lanes  1 1,  12, 13,  and  16  were  located  in  area  D.  The  soil  characteristics  of 
area  A  were  noticeably  different  from  the  other  three  areas. 

Mine  density  was  chosen  to  ensure  that  the  areas  encompassing  the  mines  plus 
halo  did  not  overlap.  The  same  ten  mine  types  used  at  Aberdeen  were  emplaced  at 
Socorro.  Mines  were  emplaced  both  on  the  surface  and  at  several  depths  below  the 
surface  ranging  from  1  inch  deep  to  depths  not  exceeding  4  in.  Depth  was  measured  from 
the  surface  to  the  top  of  the  mines.  To  ensure  accurate  ground  truth  for  comparison  to 


II-6 


demonstrator  declarations  of  potential  target  locations,  the  positions  of  the  mines  were 
surveyed  after  the  mines  were  placed  in  the  holes  but  before  the  holes  were  filled. 

1.  Mines  Emplaced  in  On-Road  Test  Lanes  at  Socorro 

The  VMMD  technologies  were  tested  on  seven  on-road  lanes  at  Socorro.  Seven 
on-road  calibration  lanes  were  made  available  to  the  demonstrators  before  testing.  Each 
of  the  on-road  calibration  lanes  contained  a  mix  of  mines  whose  type  and  burial  depths 
closely  matched  the  characteristics  of  the  mines  that  would  be  encountered  in  the  test 
lane.  The  seven  on-road  test  lanes  were  approximately  80  to  190  m  long  and  3.0  m  wide, 
resulting  in  an  approximate  total  test  area  of  3,090  m^,  which  is  nearly  the  same  as  at 
Aberdeen,  where  the  area  was  3,185  m2.  In  a  given  area,  the  test  lanes  ran  parallel  to  one 
another  and  were  separated  by  at  least  10  m.  Because  the  Socorro  site  was  divided  into 
four  areas,  contractors  could  take  turns  in  a  given  area  and  avoid  system  interference 
problems. 

Table  II-7  lists  the  number,  type,  metal  content,  and  diameter  of  the  AT  mines 
emplaced  in  each  on-road  test  lane  at  Socorro.  Also  given  are  the  totals  by  lane  and  mine 
type,  as  well  as  the  length  and  mine  density  of  each  lane. 


Table  11-7.  Mines  Emplaced  in  On-Road  Lanes  at  Socorro 


Name 

Metal 

Content 

Diameter 

(m) 

Lane 

1 

Lane 

4 

Lane 

6 

Lane 

8 

Lane 

11 

Lane 

12 

Lane 

13 

Totals 

EM12a 

NM 

i 

1 

1 

1 

1 

1 

1 

7 

M15 

M 

1 

2 

1 

3 

2 

1 

2 

12 

Ml  51 

M 

0 

0 

1 

1 

2 

1 

1 

6 

M19b 

LM 

0.3320 

2 

3 

1 

2 

2 

1 

1 

12 

M19I" 

LM 

0.3320 

1 

1 

2 

3 

2 

2 

3 

14 

TM46 

M 

1 

1 

1 

1 

1 

1 

1 

7 

TM62M 

3 

3 

4 

5 

0 

3 

2 

20 

TM62MI 

M 

0.3200 

2 

2 

0 

1 

5 

1 

3 

14 

TM62P 

0.3200 

2 

2 

2 

3 

2 

2 

2 

15 

TMA4 

0.2800 

1 

2 

2 

4 

2 

2 

2 

15 

Total 

14 

17 

15 

24 

19 

15 

18 

122 

Lane  Length  (m) 

80.0 

170.1 

160.0 

190.0 

160.0 

110.0 

160.0 

1030.1 

Mines  per  meter  of  road 

0.175 

0.100 

0.094 

0.126 

0.119 

0.136 

0.113 

0.118 

a  These  are  plastic  surrogates. 

b  The  Ml  9  and  Ml  91  are  square  mines  of  width  0.3320  m. 


The  total  number  of  mines,  lane  length,  and  mine  density  for  each  of  the  seven 
on-road  test  lanes  at  Socorro  varied  greatly.  The  TM62M  (and  TM62MI)  appeared  the 
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most,  at  34  times.  The  nonmetal  EM12  and  the  metal  TM46  were  used  sparingly;  only 
one  of  each  was  buried  in  each  of  the  seven  test  lanes.  The  total  number  of  mines  buried 
in  a  given  lane  ranged  from  14  in  lane  1  to  24  in  lane  8.  The  length  of  the  lanes  varied 
from  80  m  for  lane  1  to  190  m  for  lane  8.  Finally,  the  mine  density  varied  by  a  factor  of 
2:  from  0.094  m"'  in  lane  6  to  0.175  nT1  in  lane  1.  The  total  number  of  mines  emplaced  in 
the  on-road  test  lanes  was  122,  compared  to  109  at  Aberdeen. 

Table  II-8  shows  the  distribution  of  mines  for  on-road  test  lanes  by  metal  content 
and  emplaced  depth.  For  each  of  the  seven  on-road  test  lanes,  the  number  of  metal  and 
low-metal  mines  was  nearly  the  same,  and  comprised  approximately  95  percent  of  the 
total  mines.  Only  one  nonmetal  mine  was  used  in  each  of  the  on-road  test  lanes.  In  terms 
of  emplaced  depth,  there  was  little  variation  in  the  distribution  of  mines  in  each  on-road 
test  lane.  Approximately  40  percent  of  the  mines  were  located  on  the  surface.  The 
remaining  60  percent  of  the  mines  were  buried,  most  at  the  1.5-in.  and  2-in.  depths.  Only 
about  15  percent  of  the  mines  were  buried  more  deeply  than  2  in. 


Table  11-8.  Mine  Types  and  Depths  for  On-Road  Lanes  at  Socorro 


Lane 

1 

Lane 

4 

Lane 

6 

Lane 

8 

Lane 

11 

Lane 

12 

Lane 

13 

Totals 

Total  Number 

14 

17 

15 

24 

19 

15 

18 

122 

Emplaced 

Metal  Content 

M 

7  (50%) 

8  (47%) 

7  (47%) 

11  (46%) 

10(53%) 

7  (47%) 

9  (50%) 

59  (48%) 

LM 

6  (43%) 

8  (47%) 

7  (47%) 

12  (50%) 

8  (42%) 

7  (47%) 

8  (44%) 

56  (46%) 

NM 

1  (7%) 

1  (6%) 

1  (7%) 

1  (4%) 

1  (5%) 

1  (7%) 

1  (6%) 

7  (6%) 

Depth 

Surface 

5  (36%) 

8  (47%) 

6  (40%) 

8  (33%) 

8  (42%) 

5  (33%) 

8  (44%) 

48  (39%) 

1.5  in. 

3  (21%) 

3(18%) 

4  (27%) 

6  (25%) 

5  (26%) 

4  (27%) 

4  (22%) 

29  (24%) 

2  in. 

4  (29%) 

4  (24%) 

3  (20%) 

6  (25%) 

4(21%) 

4  (27%) 

4  (22%) 

29  (24%) 

3  in. 

1  (7%) 

1  (6%) 

1  (7%) 

2  ( 8%) 

1  (5%) 

1  (7%) 

1  (6%) 

8  (7%) 

4  in. 

1  (7%) 

1  (6%) 

1  (7%) 

2  (8%) 

1  (5%) 

1  (7%) 

1  (6%) 

8  (7%) 

Table  II-9  shows  the  number  of  mines  by  burial  depth  for  the  metal,  low-metal, 
and  nonmetal  mines  for  the  on-road  test  lanes  at  Socorro.  The  same  trends  observed  at 
Aberdeen  were  present  at  Socorro.  Namely,  the  metal  TM62M  (and  TM62MI)  mine  was 
the  only  mine  found  at  a  depth  of  4  in.,  and  the  low-metal  TM62P  mine  was  the  only 
mine  buried  at  3  in.  In  addition,  the  nonmetal  EM  12  mine  was  only  emplaced  at  a  depth 
of  2  in.;  at  Aberdeen,  this  mine  was  found  on  the  surface. 
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Table  11-9.  Mine  Depths  and  Metal  Content  for  On-Road  Lanes  at  Socorro 


Metal 

Low 

Metal 

Non- 

metal 

Totals 

Total  Number 

59 

56 

7 

122 

Emplaced 

Depth 

Surface 

24(41%) 

24  (43%) 

0  (0%) 

48  (39%) 

1.5  in. 

14(24%) 

15(27%) 

0  (0%) 

29  (24%) 

2  in. 

13(22%) 

9  (16%) 

7  (100%) 

29  (24%) 

3  in. 

0  (0%) 

8  (14%) 

0  (0%) 

8  (7%) 

4  in. 

8  (14%) 

0  (0%) 

0  (0%) 

8  (7%) 

2.  Mines  Emplaced  in  Off-Road  Test  Lanes  at  Socorro 

The  AT  mines  emplaced  in  the  one  off-road  test  lane  at  Socorro  are  listed  in 
Table  11-10.  The  only  nonmetal  mine,  the  EM12,  was  not  emplaced  in  lane  16.  In  addi¬ 
tion,  none  of  the  inert  mines  were  emplaced  in  lane  16.  The  TM62M  appears  the  most  at 
9  times,  while  the  TM46  appears  the  least  at  1  time.  The  total  number  of  mines  emplaced 
in  the  off-road  test  lanes  was  only  24,  compared  to  122  for  the  on-road  test  lanes,  and  it  is 
also  less  than  half  the  total  number  of  mines  emplaced  in  the  off-road  test  lanes  at 
Aberdeen.  The  mine  density  for  the  off-road  test  lane  was  0.268  m"1,  or  approximately 
twice  that  of  the  average  mine  density  for  the  on-road  test  lanes.  This  is  an  important 
point  which  will  be  discussed  in  relation  to  the  performance  measure  of  false-alarm  rate 
in  Chapter  3. 


Table  11-10.  Mines  Emplaced  in  Off-Road  Lanes  at  Socorro 


Name 

Metal  Content 

Diameter  (m) 

Lane  16 

EM12a 

NM 

0.3048 

0 

M15 

M 

0.3370 

4 

M15I 

M 

0.3370 

0 

M19b 

LM 

0.3320 

4 

M19I 

LM 

0.3320 

0 

TM46 

M 

0.3050 

1 

TM62M 

M 

0.3200 

9 

TM62MI 

M 

0.3200 

0 

TM62P 

LM 

0.3200 

3 

TMA4 

LM 

0.2800 

3 

Total 

24 

Lane  Length  (m) 

89.6 

Mines  per  meter  of  road 

0.268 

a  These  are  plastic  surrogates. 

b  The  M19  and  Ml  91  are  square  mines  of  width  0.3320  m. 
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The  distribution  of  mines  for  the  off-road  test  lane  by  metal  content  and  emplaced 
depth  is  shown  in  Table  II- 1 1 .  More  than  half  of  the  mines  are  metallic,  while  the  remain¬ 
der  are  low  metal.  No  nonmetal  mines  were  used  on  the  off-road  lane  at  Socorro.  This  is 
consistent  with  the  test  lanes  at  Aberdeen.  Approximately  40  percent  of  the  mines  were 
located  on  the  surface.  The  remaining  62  percent  of  the  mines  were  buried  at  depths  of 
1 .5,  2,  3,  and  4  in.  As  with  the  on-road  test  lanes,  about  40  percent  of  the  mines  were 
emplaced  at  depths  of  1.5  and  2  in.,  and  25  percent  of  the  mines  were  emplaced  more 
deeply  than  2  in.,  with  2  buried  at  3  in.  and  4  buried  at  4  in. 

Table  11-12  shows  the  mine  distribution  for  the  off-road  test  lanes  at  Socorro  by 
burial  depth  and  metal  content.  As  with  the  on-road  test  lanes,  the  metal  TM62M  (and 
TM62MI)  mine  was  the  only  mine  found  at  a  depth  of  4  in.,  and  the  low-metal  TM62P 
mine  was  the  only  mine  buried  at  3  in. 

Table  11-11.  Mine  Types  and  Depths  for  Off-Road  Lane  at  Socorro 


Lane  16 

Total  Number  Emplaced 

24 

Metal  Content 

M 

14  (58%) 

LM 

10(42%) 

NM 

0  (0%) 

Depth 

Surface 

9  (38%) 

1.5  in. 

6  (25%) 

2  in. 

3(13%) 

3  in. 

2  (8%) 

4  in. 

4  (17%) 

Table  11-12.  Mine  Depths  and  Metal  Content  for  Off-Road  Lane  at  Socorro 


Metal 

Low 

Metal 

Totals 

Total  Number 

14 

10 

24 

Emplaced 

Depth 

Surface 

6  (43%) 

3  (30%) 

9  (38%) 

1.5  in. 

3  (21%) 

3  (30%) 

6  (25%) 

2  in. 

1  (7%) 

2  (20%) 

3(13%) 

3  in. 

0  (0%) 

2  (20%) 

2  (8%) 

4  in. 

4  (29%) 

0  (0%) 

4(17%) 
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Note  that  only  metal  mines  were  emplaced  at  a  depth  of  4  in.  and  only  low-metal 
mines  were  emplaced  at  a  depth  of  3  in.  Because  the  distribution  of  metal,  low-metal,  and 
nonmetal  mines  is  not  uniform  for  two  of  the  five  burial  depths  at  both  sites,  no  perform¬ 
ance  measures  will  be  analyzed  as  a  function  of  depth. 

C.  ATD  SCHEDULE 

Table  11-13  shows  the  order  in  which  the  test  lanes  were  completed  by  each 
contractor.  The  nomenclature  is  L-#  where  L  is  a  one-  or  two-digit  number  indicating  the 
lane  number,  and  #  is  either  a  1  or  2  corresponding  to  the  first  and  second  passes  of  the 
lane.  For  both  sites,  all  five  contractors  were  able  to  complete  the  required  tests.  Each  on¬ 
road  and  off-road  test  lane  was  traversed  two  times,  where  the  direction  of  travel  of  was 
reversed  between  successive  runs  on  the  same  lane.  Note  that  GeoC  completed  the  test 
requirements  first  at  both  sites. 

D.  ADDITIONAL  RUNS 

In  addition  to  the  scored  runs  conducted  during  daylight  hours,  four  additional 
runs  were  made.  They  included  night  runs,  physical  marking  runs,  tele-operated  runs,  and 
morning  rims.  These  tests  were  included  in  the  overall  ATD  as  a  measure  of  system 
performance  under  special  circumstances.  Table  11-14  shows  which  contractors  per¬ 
formed  the  four  additional  tests  at  each  of  the  sites.  Note  that  all  five  contractors 
conducted  night  tests  at  both  sites  and  that  four  out  of  the  five  contractors  conducted 
physical  marking  tests.  At  Aberdeen,  the  only  other  additional  run  was  the  tele-operated 
run  conducted  by  GeoC.  At  Socorro,  EG&G  and  GeoC  conducted  tele-operated  tests,  and 
CRC  and  GDE  conducted  morning  tests.  Note  that  CDC’s  vehicle  was  always  tele- 
operated,  hence  separate  tele-operated  runs  were  not  necessary.  Each  of  the  additional 
tests  typically  involved  two  or  three  passes  of  a  given  lane.  Table  11-15  gives  a  complete 
list  of  the  lanes  that  were  used  for  each  of  the  additional  runs,  where  N  denotes  night  run, 
PM  denotes  a  physical-marking  run,  EM  denotes  an  electronic-marking  run  performed  in 
conjunction  with  a  physical-marking  run,  T  denotes  tele-operated  run,  and  M  denotes 
morning  run.  All  the  additional  runs  were  made  on  the  on-road  lanes 
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Table  11-13.  ATD  Completion  Schedule  (Lane  No.-  Pass) 


Aberdeen 

Jun.  9 

Jun.  10 

Jun. 11 

Jun.  15 

Jun.  16 

Jun.  17 

CDC 

2-1,  2-2 

15-1,  15-2 

11-1,  11-2 

12-1 

12-2,  4-1 

4-2 

CRC 

12-1,  12-2 

4-1, 4-2, 
11-1 

11-2, 

2-1,  2-2, 
15-1,  15-2 

EG&G 

11-1,  11-2 

12-1 

15-1 

15-2,  12-2, 
4-1 

2-1, 4-2, 
2-2 

GDE 

15-1,  11-1 

15-2,  12-1 

12-2,  11-2, 
2-1 

2-2 

4-1 

4-2 

GeoC 

11-1,  12-1, 
12-2,  11-2, 
15-1,  15-2 

2-1,  2-2 

4-1,  4-2 

Socorro 

Jul.  14 

Jul.  15 

Jul.  16 

Jul.  17 

Jul.  20 

Jul.  21 

Jul.  22 

CDC 

13-1, 

11-1 

11-2, 

13-2 

1-1.  1*2, 
4-1,  4-2 

8-1, 

8-2 

12-1, 

12-2, 

16-1 

6-1, 

6-2, 

16-2 

CRC 

8-1,  8-2, 
1-1,  1-2 

6-1,  6-2, 
4-1,  4-2, 
11-1,  11-2, 
12-1,  12-2 

13-1 

13-2, 

16-1, 

16-2 

EG&G 

8-1,  8-2, 
11-1,  13-1, 
11-2,  13-2 

4-1,  4-2 

6-1,  6-2 

12-1, 

12-2, 

16-1, 

16-2 

1-1,  1-2 

GDE 

8-1,  8-2, 
6-1,  6-2 

13-1, 

13-2, 

1-1 

11-1 

4-1, 4-2, 
1-2 

12-1, 

12-2 

11-2, 

16-1, 

16-2 

GeoC 

1-1,  1-2 

11- 1,13-1, 

12- 1,12-2, 
13-2,  11-2 

8-1,  8-2, 
4-1,  4-2, 
6-1,  6-2 

16-1, 

16-2 

11-12 


Table  11-14.  Additional  Runs  for  Contractors  at  Aberdeen  and  Socorro 


Aberdeen 

Socorro 

Contractor 

Night 

Physical 

Marking 

Tele- 

Operated 

Night 

Physical 

Marking 

Tele- 

Operated 

Morning 

CDC 

✓ 

✓ 

* 

CRC 

✓ 

✓ 

✓ 

/ 

EG&G 

✓ 

✓ 

✓ 

✓ 

/ 

GDE 

✓ 

✓ 

s 

✓ 

✓ 

✓ 

s 

/ 

CDC’s  system  is  tele-operated,  hence  separate  tele-operated  runs  were  not  necessary. 


Night  runs  were  made  several  hours  after  sunset;  morning  runs  were  made  before 
10:00  a.m.  Tele-operated  runs  involved  the  remote  operation  of  the  contractor  vehicle. 
For  physical  marking  runs,  the  vehicle  sprayed  marks  onto  the  surface  of  the  lanes  to 
designate  an  alarm.  The  marks  were  surveyed  and  an  alarm  file  was  created  after  the 
vehicle  completed  a  lane.  Usually,  the  contractor  provided  electronic  alarms  in  addition 
to  the  physical  alarms,  allowing  the  direct  comparison  of  the  two  methods  of  alarm 
marking. 

The  results  of  the  additional  runs  appear  in  Appendix  B.  Tables  B-6  through  B-8 
summarize  the  additional  runs  conducted  at  Aberdeen,  and  Tables  B-17  through  B-24 
summarize  the  additional  runs  conducted  at  Socorro.  In  Chapter  V  of  this  report 
(Individual  Contractor  Performance),  we  will  discuss  these  additional  tests.  The  reason 
for  not  including  additional  runs  in  Chapter  IV  (Performance  Comparisons)  is  related  to 
the  poor  statistical  significance  of  the  performance  measures  of  the  additional  runs.  There 
are  three  reasons  why  these  performance  measures  are  not  statistically  significant.  First, 
there  were  only  a  very  small  number  of  mine  encounters  for  a  given  test  condition,  the 
result  of  a  given  contractor  making  only  two  or  three  passes  on  a  lane.  Second,  not  all 
contractors  performed  each  test  (except  the  night  test).  Third,  for  all  the  additional  tests, 
the  contractors  did  not  make  passes  on  the  same  lanes.  For  instance  (see  Table  11-15),  at 
Socorro,  GeoC  conducted  three  night  runs  on  lanes  11,  12,  and  13,  while  EG&G  con¬ 
ducted  night  runs  on  lanes  4  and  6.  This  lack  of  comparable  encounters  allows  us  only  to 
make  observations  relating  to  the  specifics  of  each  of  the  additional  runs. 
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III.  MEASURES  OF  PERFORMANCE 


A.  DETERMINING  A  DETECTION 

Contractor  declarations  of  potential  mine  locations  are  either  matched  to  an 
emplaced  mine  and  considered  a  “detection,”  or  not  matched  to  a  mine  and  called  a  “false 
alarm.”  Declarations  are  matched  to  emplaced  mines  if  the  declaration  is  within  a  critical 
distance,  /?halo,  of  the  edge  of  the  mine.  The  value  for  i?hal0  is  taken  to  be  1  m,  as  is  directed 
in  the  GSTAMIDS  ORD.  This  distance  criterion  can  produce  more  than  one  candidate 
declaration  which  matches  a  particular  emplaced  mine.  For  this  case,  the  demonstrator  is 
credited  with  a  single  detection  of  the  mine,  attributed  to  the  nearest  declaration,  while 
the  other  declarations  within  Rha]0  are  considered  redundant  and  are  not  counted  as  either 
detections  or  false  alarms.  If  the  declaration  is  within  J?hal0,  but  outside  the  mine  lane,  it  is 
still  scored  as  a  valid  detection.  If  a  declaration  is  not  within  Rhal0  of  any  emplaced  mine, 
and  is  located  within  the  mine  lane,  then  that  declaration  is  considered  a  false  alarm. 
These  possible  outcomes  are  illustrated  in  Figure  III-l. 


Figure  111-1.  Mine  and  Halo 

B.  DETECTION  PROBABILITY  AND  FALSE-ALARM  RATE 

The  probability  of  detection  is  simply  the  fraction  of  the  emplaced  mines  that  are 
detected  by  a  contractor: 

p  number  of  mines  detected  ^ 

d  number  of  mines  emplaced 
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We  calculated  Pd  for  each  road  condition  (on-  and  off-road),  mine  depth  (surface  and 
subsurface),  metal  content  of  the  mine  (metal,  low  metal,  and  nonmetal),  and  sensor  type. 

The  false-alarm  rate,  FAR,  is  defined  as  the  number  of  false  alarms  in  the  test  site 
divided  by  the  total  area  of  the  site,  Asiu,3  The  FAR  is  separately  calculated  for  each  road 
condition  and  sensor  type  combination.  Note  that  some  false  alarms  can  be  credited  to  a 
single  sensor,  while  others  could  be  credited  to  more  than  one  sensor.  If  more  than  one 
sensor  produced  a  single  false  alarm,  we  use  that  alarm  in  each  of  the  sensor’s  FAR. 
Thus,  the  FAR  for  a  contractor’s  total  system  will  not  be  the  sum  of  the  FARs  from  each 
of  the  individual  sensors. 

C.  CORRECTION  TO  THE  FALSE-ALARM  RATE 

The  false-alarm  rate  as  defined  by  TECOM  can  be  misleading  when  the  density  of 
mines  within  the  mine  lane  is  large,  because  only  the  fraction  of  the  mine  lane  that  is  not 
included  within  i?halo  of  each  of  the  mines  can  provide  an  opportunity  for  a  false  alarm. 
Dividing  the  number  of  false  alarms  by  the  entire  mine  lane  area,  Asjle,  makes  FAR  into  a 
quantity  that  is  dependent  on  the  mine  density  in  the  test  lane,  as  well  as  on  the  choice  of 
i?hab.  Therefore,  if  the  density  of  the  mines  within  the  mine  lane  is  large  (which  is  the  case 
for  all  mine  lanes  and  especially  true  in  the  off-road  lane  used  at  Socorro),  then  the  FAR 
underestimates  the  true  density  of  false  alarms  and  misrepresents  the  performance  of  the 
sensors.  This  is  clearly  not  a  satisfactory  definition  of  the  false-alarm  rate. 

A  better  measure  of  the  false-alarm  rate  should  only  be  dependent  on  the  sensor 
and  on  the  bare  (unmined)  soil  characteristics  of  the  region  being  surveyed.  To  construct 
this  more  robust  metric  for  the  false-alarm  rate,  the  number  of  false  alarms  should  be 
divided  by  the  area  of  the  lane  that  is  not  within  f?hal0  of  a  mine  (in  other  words,  use  the 
same  area  from  which  the  false  alarms  are  drawn).  This  formulation  should  be  used 
because  within  the  halo  radius  of  a  mine  there  is  no  “operational”  opportunity  for  a  false 
alarm.  We  define  this  area  to  be  AsileJa,  where  AsileJa  =  (Asite  -  Xmines  A^J.  A^c  is  the  average 
area  covered  by  a  mine  plus  its  halo: 

^dec=AR  mine+^halo)2  •  (2) 


3  See  Section  2.2.4  of  Detailed  Test  Plan  for  the  Engineering  Development  Test  (Advanced  Technology 
Demonstration)  of  the  Ground  Standoff  Minefield  Detection  System,  TECOM  Project  No.  8-ES-025- 
GMD-001. 
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The  difference  between  this  “true”  false-alarm  rate  and  the  FAR  defined  by  TECOM 
depends  on  the  density  of  mines  in  the  test  lanes.  For  example,  the  FAR  on  some  on-road 
lanes  at  Socorro  will  be  as  much  as  30  percent  larger  using  the  true  measure.  In  an 
extreme  case,  41  percent  of  Socorro’s  off-road  lane  (lane  16)  was  covered  by  mines  plus 
their  halos,  thereby  making  the  true  FAR  1 .6  times  larger  than  the  FAR  from  TECOM’s 
definition. 

In  spite  of  this  deficiency,  we  use  TECOM’s  FAR  definition  in  the  remainder  of 
this  report. 

D.  PROBABILITY  OF  FALSE  ALARM 

The  probability  of  a  false  alarm,  P/a,  is  defined  as  the  probability  that  there  will  be 
a  false  alarm  within  the  area  of  the  average  mine  plus  its  halo.  We  use  this  measure  of  P fa 
as  a  surrogate  for  the  true  P/a,  which  is  the  number  of  false  alarms  divided  by  the  number 
of  opportunities  for  false  alarms.  Since  it  is  difficult,  if  not  impossible,  to  determine  the 
actual  number  of  opportunities  within  a  mine  lane,  this  areal-based  surrogate  metric  is 
necessary.  The  areal-based  definition  used  herein  also  provides  an  excellent  intuitive 
measure:  since  all  of  the  mines  are  very  similar  in  size,  Pfa  gives  the  probability  that  a 
mine  in  this  test  was  detected  purely  by  an  “accident”  caused  by  the  overlap  of  a  false 
alarm  with  a  mine’s  halo. 

As  in  previous  tests  evaluated  by  IDA  (Andrews  et  al.,  1996  and  1998),  we  use 
the  quantities  AsileJa  and  A^,  as  defined  above,  to  compute  the  Pfa.  Only  the  unique  area  of 
the  mine  lane  covered  by  the  characteristic  false-alarm  area  associated  with  each  false 
alarm  is  used  to  determine  Pfa  (see  Figure  III-2).  Thus,  no  double  counting,  and  no 
counting  of  area  within  /?halo  of  the  emplaced  mines  results.  This  ensures  a  Pfa  that  is 
bound  by  zero  and  one. 


Figure  111-2.  Example  of  a  P„  Calculation  in  a  Mine  Lane.  The  mines  are  marked  by  the  black 
circles.  The  halo  area  is  defined  by  the  circle  surrounding  the  mines. 

The  gray  circles  represent  the  false  alarms.  Only  the  area 
shown  in  gray  is  counted  in  the  determination  of  P„. 
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Thus,  Pfa,  is  then  calculated  as  the  sum  of  the  unique  area  of  declaration  (A^c)  for 
each  false  alarm  divided  by  the  total  area  of  the  site  where  there  is  an  opportunity  for  a 
false  alarm: 


Pfa  = 


IX 

unique 

A 

** site  fa 


(3) 


The  quantity  ^Adec  is  the  sum  of  A^c  for  all  false  alarms,  but,  as  shown  in  Figure  III-2, 

unique 

does  not  double  count  overlaps  of  area.  Again,  since  the  mines  used  in  this  test  are  all  AT 
mines  of  similar  size,  Pfa  effectively  gives  the  probability  that  any  of  the  mines  in  the  test 
would  be  detected  by  a  random  false  alarm. 


E.  STATISTICAL  UNCERTAINTY 

Pd  and  FAR  are  statistical  measures.  The  confidence  to  which  they  are  determined 
will  depend  on  the  size  of  the  populations  measured.  Error  bars  are  calculated  for 
probability  of  detection  using  a  binomial  distribution  and  determining  the  90-percent  con¬ 
fidence  interval  (Bevington,  1969).  The  binomial  distribution  is  employed  to  estimate 
lower  and  upper  bounds  for  the  detection  rates  from  the  demonstration  (Simonson,  1998). 
To  determine  the  confidence  interval,  binomial  probabilities  are  calculated  for  the  likeli¬ 
hood  of  detecting  X  mines  out  of  N  opportunities  for  each  population  of  interest  (see 
Figure  III-3).  The  lower  and  upper  bounds  are  determined  iteratively  such  that  the 
binomial  distribution  for  each  bound  contains  the  measured  Pd  within  its  90-percent 
confidence  interval.  If  the  confidence  intervals  of  the  performance  metrics  for  different 
systems  overlap,  there  is  no  statistically  significant  difference  between  the  two  measure¬ 
ments  at  the  indicated  confidence  level.  If  the  confidence  intervals  of  the  metric  are 
separated,  then  one  system  has  performed  “better”  than  the  other,  in  terms  of  that  metric. 

Uncertainties  are  calculated  only  for  the  probability  of  detection.  A  substantial 
effort  was  made  to  include  a  sufficient  number  of  encounters  to  provide  statistical  confi¬ 
dence  in  the  determination  of  Pd.  But  when  the  mines  are  divided  into  categories  such  as 
metal  content,  depth,  filler,  etc.,  the  uncertainty  for  these  subsets  increases  substantially. 
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Figure  111-3.  Binomial  Distribution  Model  for  Upper  Bound  of  the 
Confidence  Interval  for  Probability  of  Detection 

F.  ROC  CURVES  AND  THE  d  PERFORMANCE  METRIC 

It  is  possible  to  represent  sensor  capability  by  means  of  a  receiver  operating 
characteristic  (ROC)  curve.  The  ROC  curve  describes  the  relationship  between  Pd  and  P/a 
as  a  sensor’s  threshold  for  declaring  a  detection  is  changed.  The  average  ratio  of  a 
target’s  signal  to  the  clutter  signal,  called  the  d  metric  in  this  report,  can  be  derived  from 
Pd  and  Pfa  and  is  another  measure  of  a  sensor’s  capability. 

Figures  III-4  and  III-5  illustrate  these  principles.  Figure  III-4  shows  the  signal- 
strength  distribution  of  clutter  and  noise  (on  the  left),  as  well  as  the  signal-strength 
distribution  of  target,  clutter,  and  noise  (on  the  right).  For  the  purpose  of  this  discussion, 
we  assume  that  the  signal  contribution  from  clutter  and  noise  is  the  same  when  surveying 
mined  or  unmined  ground,  hence  the  difference  between  the  distributions  in  Figure  III-4 
is  a  simple  offset  that  is  due  to  the  target’s  signal  strength.  In  this  example,  the 
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distributions  are  Gaussian,  and  the  offset  is  chosen  to  be  3  a.  The  value  for  d  is  thus  3, 
and  is  the  average  value  of  the  target-to-clutter  value. 


signal  strength 


Figure  111-4.  Separation  of  the  Signal  Strength  of  Clutter  +  Noise  and  Target  +  Clutter 
+  Noise.  In  this  example,  the  separation  of  the  distributions  is  3a,  where  a 
is  the  standard  deviation  of  each  of  the  distributions.  This  separation 
is  given  by  the  quantity  d.  See  text  for  details. 

Consider  a  threshold  that  is  set  on  Figure  III-4  such  that  all  signals  below  the 
threshold  are  not  considered  mines,  and  all  signals  above  the  threshold  are  considered 
mines.  Both  the  probability  for  correctly  choosing  mines  (accepting  signals  from  the  solid 
curve),  as  well  as  the  probability  for  choosing  false  alarms  (accepting  signals  from  the 
dashed  curve)  change  as  the  threshold  level  changes.  These  probabilities  are  the  Pd  and 
P  respectively.  Even  though  the  Pd  and  Pfa  values  change  with  the  choice  of  threshold, 
the  fundamental  ability  of  the  sensor  to  separate  targets  from  false  alarms  does  not 
change,  since  the  curves  in  Figure  III-4  are  always  separated  by  d=  3. 

Figure  III-5  shows  Pd  vs.  Pfa  for  d  =  1,  2,  and  3.  Since  each  of  these  curves 
represents  a  single  value  of  d  (or  a  single  value  for  the  average  target-to-clutter  separa¬ 
tion),  they  represent  isoperformance  curves  for  the  sensors.  If  the  detection  and  false 
alarm  probabilities  are  known,  d  can  be  computed: 

d  =  ->/ 2  (erfmv(l  -  2 Pj-a)  -  erfinv(l  -  2Pf)^  ,  (4) 

where  erfinv(x)  is  the  inverse  error  function  of  x. 


Figure  111-5.  Pd  vs.  Pfe  for  Different  Values  of  d.  Each  curve  represents 
points  made  by  varying  the  threshold  on  a  sensor,  while  keeping 
the  performance  of  the  sensor  constant.  See  text  for  details. 

The  advantage  of  using  the  ROC  curves  to  assess  performance — which  is  no  more 
than  plotting  a  contractor’s  performance  on  Pd  vs.  Pfa  plots  and  computing  the  values  for 
the  d  metric — permits  us  to  separate  a  contractor’s  choice  of  threshold  from  its  ability  to 
distinguish  mines  from  clutter.  This  can  sometimes  be  more  telling  than  simply  looking  at 
Pd  and  FAR.  When  computing  the  error  on  the  value  of  d,  we  take  the  errors  on  P#  place 
them  in  Eq.  4  above,  and  obtain  the  error  bounds  on  d.  We  do  not  include  errors  in  r* 
which  are  small  but  still  contribute  to  the  overall  uncertainty  in  the  d  metric. 

G.  POSITION  RESOLUTION 

For  each  contractor,  we  compile  the  distribution  of  miss  distances  for  all  detec¬ 
tions  (both  credited  and  redundant)  in  the  along-track  and  cross-track  dimensions.  The 
miss  distance  is  defined  as  the  difference  between  the  declaration  position  and  the  center 
of  a  mine.  From  these  distributions  we  compute  the  position  resolution,  or  root  mean 
square  (RMS),  as  well  as  the  offset,  or  bias,  of  the  sensor  systems  in  detecting  AT  land¬ 
mines.  The  RMS  is  a  measure  of  the  intrinsic  position  resolution  of  the  sensor  system. 
The  bias  of  the  sensor  system  is  a  measure  of  the  systematic  offset  in  the  estimated 
position  of  the  mines. 
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We  assume  that  the  miss-distance  distributions  will  exhibit  two  characteristic 
shapes:  first,  a  flat  shape  caused  by  randomly  distributed  “lucky”  false  alarm  overlaps; 
and  second,  a  Gaussian  shape  that  results  from  the  detector  system  actually  sensing 
mines.  This  shape  assumption  is  in  fact  an  excellent  match  to  the  actual  distributions,  as 
will  be  shown  in  the  contractor  performance  section  of  this  report. 

To  extract  the  RMS  resolution  and  bias  of  the  contractors’  sensors,  it  is  not 
accurate  to  simply  compute  the  mean  and  standard  deviation  of  the  miss-distance  distri¬ 
bution,  because  random  false  alarms  contribute  a  constant  (flat)  background  to  these 
distributions.  This  false-alarm  background  contributes  to  the  RMS,  and,  ideally,  we  want 
only  to  measure  the  RMS  and  bias  of  the  sensor  detecting  a  mine. 

We  can  separate  the  false  alarms  from  the  detections  by  fitting  the  along-  and 
cross-track  distributions  to  the  following  function: 

f=c  +  a-e  2w*  (4) 

The  constant  term  c  represents  the  flat  false-alarm  contribution  to  the  detections;  the 
Gaussian  parameters  a,  m,  and  w  model  the  response  of  the  sensor  system  to  the  mines, 
with  w  and  m  representing  the  RMS  and  bias,  respectively.  The  miss-distance  data  used 
in  the  fit  was  binned  in  10-cm  bins,  with  the  error  in  each  bin  taken  to  be  the  square  root 
of  the  number  of  entries  in  the  bin.  If  there  are  no  entries  in  a  bin,  we  took  the  error  to 
be  1 .  The  fits  are  performed  by  finding  the  function  parameters  of  f  which  minimize  the 
X  of  the  fit,  where  j2  =  Z/(xfit  -xtf  erf,  where  i  is  the  index  of  a  given  bin. 

In  summary,  the  RMS  gives  the  resolution  (or  spread)  of  the  sensors’  position 
estimate,  while  the  bias  gives  the  average  offset  in  the  sensor’s  position  estimate.  We 
provide  the  RMS  resolution  and  bias  for  each  of  the  contractors  for  different  road  condi¬ 
tions,  mine  dispositions,  and  sensor  types. 

H.  DETECTION  SPEED 

We  calculated  the  average  detection  speed  of  the  five  contractors  at  Aberdeen  and 
Socorro  for  both  on-road  and  off-road  conditions  (see  Chapter  IV).  Speeds  were  com¬ 
puted  for  the  scored  daytime  runs  by  comparing  the  first  and  last  lines  of  each  electronic 
alarm  file.  Each  line  contained  a  time-stamp  and  associated  vehicle-position.  Detection 
speed  was  found  simply  by  dividing  the  distance  traveled  by  the  time  required  to  travel 
the  distance.  This  was  done  for  each  pass  of  a  given  road-type  and  averages  were  then 
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taken.  One  contractor,  EG&G,  did  not  include  time-stamps  in  their  electronic  alarm  files, 
and  so  we  could  not  compute  the  detection  speed  of  its  system. 
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IV.  PERFORMANCE  COMPARISON 


Using  data  collected  at  the  Aberdeen  site,  the  Socorro  site,  and  the  combined  data 
from  both  test  sites,  we  compare  the  contractors’  performance.  Our  analysis  separates 
detection  of  subsurface  and  surface  mines  and  on-road  and  off-road  performance,  as  in 
the  exit  criteria. 

A.  ON-ROAD,  SUBSURFACE  MINES 
1.  Aberdeen  Results 

Figure  IV- 1  shows  Pd  vs.  FAR  for  the  five  contractors,  as  well  as  the  exit  criteria 
for  this  test.  CDC,  GeoC,  EG&G,  and  GDE  achieved  a  Pd  greater  than  the  exit  criterion 
of  85  percent.  CRC,  on  the  other  hand,  exhibited  a  detection  rate  somewhat  below  the 
exit  criteria  (over  7  percentage  points),  and  its  90-percent  confidence  interval  also  failed 
to  meet  the  detection  probability  criterion.  CRC  was  the  only  contractor  to  achieve  the 
FAR  criterion  of  0.042/m2.  Pd  and  FAR  results  are  summarized  in  Table  IV-1. 

It  is  difficult  to  judge  the  best  performance  from  Figure  IV-1  because  the  tradeoff 
between  Pd  and  FAR  is  not  obvious.  IDA  has  adopted  a  model-based  approach  using  the 
receiver  operating  characteristic  (ROC)  curve  and  a  Gaussian  formalism  to  model  the 
sensor  performance.  The  goal  of  this  approach  is  to  establish  a  performance  metric  by 
modeling  the  dependence  of  Pd  on  FAR.  The  ROC  model  generates  unique  curves  of  con¬ 
stant  performance.  The  location  of  any  point  on  a  single  curve  is  dependent  on  the  sensor 
threshold.  If  one  assumes  that  the  mine  detection  tests  provide  sensor  performance  at  a 
single  threshold,  relative  performance  of  different  sensors  can  be  interpreted  using  the 
ROC  model.  The  difficulty  with  this  assumption  is  that  for  an  operational  field  test,  the 
user  tends  to  adjust  the  gain  during  the  testing  process,  for  instance  during  the  calibration 
process,  thereby  changing  the  apparent  threshold.  Still,  averaged  over  the  set  of  mines 
and  potential  false  alarms  encountered  in  the  field,  an  “average”  threshold  exists  and  the 
ROC  model  can  be  employed  to  evaluate  performance.  To  determine  relative  per¬ 
formance,  the  single  point  representing  Pd  vs.  Pfa  for  each  sensor  is  plotted.  Pfa  is  used  in¬ 
stead  of  FAR  to  provide  a  consistent  link  to  the  statistical  performance  models  employed. 
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Figure  IV-1.  Pd  vs.  FAR  for  On-Road,  Subsurface  Mines  at  Aberdeen 


Table  IV-1.  On-Road  Subsurface  Performance,  All  Sensors 


Aberdeen 

Socorro 

FAR 

#det./ 

FAR 

P „ 

#det / 

Contractor 

(m-2) 

[Confidence] 

#enc. 

(m2) 

[Confidence] 

#enc. 

CDC 

0.054 

0.932 

123/132 

0.032 

0.892 

132/148 

[0.884-0.965] 

[0.840-0.932] 

CRC 

0.034 

0.773 

102/132 

0.037 

0.905 

134/148 

[0.704-0.832] 

[0.855-0.942] 

EG&G 

0.081 

0.932 

123/132 

0.043 

0.919 

136/148 

[0.884-0.965] 

[0.872-0.953] 

GDE 

0.068 

0.909 

119/132 

0.037 

0.899 

133/148 

[0.856-0.947] 

[0.848-0.937] 

GeoC 

0.056 

0.985 

130/132 

0.032 

0.912 

135/148 

[0.953-0.998] 

[0.863-0.948] 

This  is  a  90-percent  confidence  interval  using  the  Binomial  approach  discussed  in  Chapter  III. 


The  relative  performance  of  different  sensors  is  then  determined  by  assuming  a  Gaussian 
model  for  the  distribution  function  of  the  response  of  the  sensor  to  noise/clutter  and 
mines.  This  approach  results  in  a  single  relative  performance  measure,  the  “cT  metric 
(Van  Trees,  1968)  for  each  sensor.  Although  there  are  limits  to  this  methodology 
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(Altshuler  et  al.,  1997,  and  Andrews  et  al.,  1998),  the  approach  does  provide  a  metric  that 
is  consistent  within  a  single  test.  Thus,  we  do  not  advocate  comparisons  based  on  the  d 
metric  from  different  tests  even  within  this  ATD.  ROC  curves  and  the  d  metric  are 
discussed  in  detail  in  Chapter  III. 


Figure  IV-2a  shows  the  ROC  approach  (Pd  versus  Pfa).  The  isoperformance  curves 
(curves  of  constant  d)  on  this  plot  are  shown  as  solid  lines,  and  represent  a  contractor’s 
ability  to  separate  detections  from  false  alarms.  Based  on  these  curves,  it  seems  that 
GeoC  showed  the  best  performance  for  on-road,  subsurface  mines,  with  the  other  four 
contractors  at  a  comparable  level.  Figure  IV-2b  presents  the  d  metric  for  each  contractor, 
with  a  90-percent  confidence  interval.  It  is  apparent  from  this  figure  that  all  the  con¬ 
tractors  except  GeoC  perform  in  a  statistically  similar  manner  because  their  confidence 
intervals  overlap. 


x  CDC 

♦  CRC 

■  EG&G 

*  GDE 

•  GeoC 


Figure  IV-2.  (a)  Pd  vs.  P^,  and  (b)  the  d  Metric,  for  On-Road,  Subsurface  Mines  at  Aberdeen 

FAR  and  Pfa  are  related  to  one  another  as  described  in  Chapter  III.  Recall  that  FAR 
is  computed  by  counting  all  false  alarms  and  dividing  by  the  area  of  the  lane.  Pfa  gives  the 
probability  that  an  alarm  will  exist  within  the  equivalent  area  of  the  average  mine  plus  its 
halo  (A^J.  Thus,  if  false  alarms  tend  to  be  clumped  together  in  space,  Pfa  will  not  grow  as 
quickly  as  FAR.  Hence,  a  small  FAR-Xo-Pfa  ratio  indicates  that  the  false  alarms  are  not 
very  correlated  in  space,  while  a  large  ratio  indicates  that  there  is  a  clumping  of  false 
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alarms  in  space.  Table  IV-2  shows  the  FA R-Xo-P fa  ratio  at  Aberdeen  and  Socorro.  Note 
that  CDC  has  the  lowest  FAR-Xo-Pfa  ratio  at  Aberdeen  (0.280).  This  low  ratio  may  be  due 
to  data  fusion  of  the  individual  sensors  that  is  more  extensive  than  that  done  by  the  other 
contractors. 


Table  IV-2.  Ratio  of  FAR  to  P„  for  On-Road  Lanes 


Site 

CDC 

CRC 

EG&G 

GDE 

GeoC 

Aberdeen 

0.280 

0.420 

0.383 

0.382 

0.375 

Socorro 

0.264 

0.308 

0.326 

0.336 

0.260 

Figure  IV-3  shows  Pd  versus  FAR  for  the  five  contractors,  for  the  three  different 
mine  metal  contents.  GeoC,  CDC,  and  EG&G  show  a  slight  decrease  in  Pd  for  low-metal 
and  nonmetal  mines.  CRC  and  GDE  exhibit  a  much  sharper  drop  in  the  ability  to  sense 
these  plastic-cased  (dielectric)  mines. 


Figure  IV-4  and  Table  IV-3  show  interesting  trends  in  sensor  performance.1  First,  note 
that  for  all  five  contractors  the  GPR  was  the  single  sensor  with  the  highest  Pd.  In  some 
cases,  the  GPR  did  so  well  that  the  marginal  increase  in  Pd  from  the  IR  and  EMI  sensors 
was  hardly  significant,  such  as  with  CDC,  GDE,  and  GeoC.  (Details  of  the  marginal 
benefits  of  the  three  detectors  will  be  provided  in  the  discussion  on  individual  contractor 
performance  in  Chapter  V.)  For  example,  if  CDC  had  run  with  only  its  GPR,  its  Pd  would 
essentially  be  the  same  while  its  FAR  would  have  dropped  by  over  20  percent.  CRC  and 
EG&G,  on  the  other  hand,  depended  more  on  their  entire  sensor  package  to  achieve  their 
results.  CRC  relied  heavily  on  its  EMI  detector  in  the  case  of  metal  mines,  with  very  little 
increase  in  FAR  from  the  EMI  sensor,  as  will  be  seen  in  Chapter  V.  (Note  that  CRC  did 
not  use  its  IR  sensor  in  any  ATD  tests.)  As  will  also  be  seen  in  Chapter  V,  EG&G’s  GPR 
and  EMI  did  well  on  metal  mines,  while  in  the  case  of  low-  and  nonmetal  mines  their  IR 
detector  proved  critical  (and  resulted  in  a  noticeable  increase  in  FAR).  It  should  be  noted 
that  only  CDC  and  EG&G  used  their  IR  sensor  to  attempt  to  detect  subsurface  mines. 
GeoC  limited  their  IR  detection  to  surface  mines  only,  and  suffered  no  IR  false  alarms  at 
Aberdeen. 


Figure  IV-4.  (a)  Pd  and  (b)  FAR  as  Functions  of  Sensor  Type  for  On-Road, 
Subsurface  Mines  at  Aberdeen 


1  Recall  that  the  FAR  of  all  sensors  should  not  be  equal  to  the  FAR  of  the  individual  sensors.  Refer  to  the 
definition  of  FAR  in  Chapter  III  for  details. 
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Table  IV-3.  Detection  Rate  [90-Percent  Confidence  Intervals]  for  Each  Sensor  for 

Subsurface  Mines  at  Aberdeen 


Site 

Sensor 

CDC 

CRC 

EG&G 

GDE 

GeoC 

Aberdeen 

0.909 

[0.856/0.947] 

0.553 

[0.477-0.627] 

0.697 

[0.624/0.763] 

0.871 

[0.812/0.917] 

0.977 

[0.942/0.994] 

EMI 

0.606 

[0.530/0.678] 

0.477 

[0.402/0.553] 

0.470 

[0.395/0.546] 

0.439 

[0.365/0.515] 

0.447 

[0.373/0.523] 

IR 

0.720 

[0.648/0.784] 

N/A 

0.621 

[0.546/0.692] 

N/A 

N/A 

Socorro 

GPR 

0.811 

[0.750/0.863] 

0.818 

[0.757/0.869] 

0.905 

[0.855/0.942] 

0.885 

[0.832/0.926] 

0.912 

[0.863/0.948] 

EMI 

0.588 

[0.517/0.657] 

0.473 

[0.402/0.544] 

0.466 

[0.396/0.537] 

0.480 

[0.409/0.551] 

0.473 

[0.402/0.544] 

IR 

0.696 

[0.627/0.759] 

N/A 

0.243 

[0.185/308] 

0 

0.176 

[0.126/0.236] 

As  with  the  full  system  performance,  it  is  desirable  to  use  a  single  performance 
metric  to  compare  the  subsystems  of  each  of  the  VMMD  systems.  Care  must  be  taken 
with  this  type  of  comparison  when  complex  data  fusion  is  used.  But  for  most  of  these 
systems,  a  simple  logical  OR  (or  location-correlated  logical  OR2)  is  used  to  combine 
results  from  the  three  sensors.  Therefore,  we  can  compare  the  detection  performance  of 
each  of  the  subsystems  for  the  different  VMMD  systems  using  the  d  metric  for  each  sen¬ 
sor.  Figure  IV-5a-c  shows  Pd  versus  P/a  for  the  GPR,  EMI,  and  IR  sensors,  respectively. 
Table  IV-4  presents  the  d  metric  for  each  of  the  contractor’s  subsystems.  At  Aberdeen, 
GeoC  exhibits  the  highest  d  metric  for  a  GPR.  This  performance  exceeds  the  90-percent 
confidence  interval  of  all  other  contractors’  GPRs.  The  same  can  be  stated  for  the  EG&G 
EMI  system,  which  exhibited  perfect  detection  of  metal  mines  with  no  false  alarms.  Only 
CDC  and  EG&G  used  their  IR  for  subsurface  detection  at  Aberdeen.  Using  the  d  metric 
and  the  90-percent  confidence  interval,  it  is  possible  to  conclude  that  the  CDC  IR 
outperformed  the  EG&G  IR. 

2.  Socorro  Results 

All  of  the  contractors  achieved  the  exit  criterion  for  Pd  at  Socorro  (see  Figure  IV- 
6).  As  shown  in  Table  IV- 1,  the  contractors  are  tightly  bunched  in  P#  with  system  perfor¬ 
mance  between  89  and  92  percent.  The  overall  range  of  FAR  is  much  tighter  than  at 


2  A  location-correlated  logical  OR  uses  a  distance  criterion  between  alarms  from  two  different  sensors  to 
determine  if  the  sensor  responses  result  from  a  single  target.  If  the  distance  between  the  alarms  from 
different  sensors  is  less  than  a  given  distance,  the  two  alarms  are  combined,  and  a  single  declaration  is 
made. 
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Aberdeen:  0.032-0.043  m'2  at  Socorro  versus  0.034-0.081  m"2  at  Aberdeen.  All  of  the 
contractors  except  EG&G  achieved  the  FAR  exit  criterion.  EG&G  narrowly  missed  this 
criterion. 


x  CDC 

♦  CRC 

■  EG&G 

*  GDE 

•  GeoC 


Figure  IV-5.  Pd  vs.  FAR  for  (a)  GPR  Sensor,  (b)  EMI  Sensor,  and  (c)  IR  Sensors  for  On-Road, 
Subsurface  Mines  at  Aberdeen.  Note  that  Pu  is  shown  on  a  log  scale;  therefore, 
contractors  with  no  false  alarms  for  a  particular  sensor  are  off  scale. 

At  Socorro  the  FAR-to-P/a  ratios  for  both  CDC  and  GeoC  are  similar  and  smaller 
than  those  of  the  other  three  contractors  (see  Table  IV-2).  Here,  it  appears  that  CDC  and 
GeoC  have  less  overlap  of  the  detection  areas  surrounding  their  false  alarms.  (Note  that 
both  CDC  and  GeoC  have  the  lowest  overall  false  alarm  rate.)  The  consequence  of  this  is 
that  CRC,  EG&G,  and  GDE  have  an  opportunity  to  reduce  their  FAR  if  a  more  sophisti¬ 
cated  algorithm  is  used  to  correlate  closely  spaced  declarations. 

The  similarity  in  the  contractors’  performance  can  be  seen  in  Figure  IV-7a,  which 
is  designed  to  spread  out  disparate  performances  among  different  isoperformance  curves 
(these  curves  are  again  shown  as  black  lines  on  the  plot),  and  also  in  Figure  IV-7b,  which 
shows  the  d  metric  and  the  90-percent  confidence  interval  around  that  metric.  It  is 
apparent  that  all  five  contractors’  d  metric  confidence  intervals  overlap.  Thus,  at  Socorro 
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there  is  no  statistically  significant  difference  between  the  contractors  in  detecting  on-road 
subsurface  mines. 


Table  IV-4.  d  Metric  with  Confidence  Intervals  for  Each  Sensor 


Site 

Sensor 

CDC 

CRC 

EG&G 

GDE 

GeoC 

Aberdeen 

GPR 

1.41 

[1.22/1.61] 

2.06 

[1.71/2.31] 

3.11 

[2.68-3.64] 

EMI 

1.51 

[1.31/1.70] 

t 

2.32 

[2.13/2.51] 

1.99 

[1.80/2.18] 

IR 

2.24 

[2.04/2.44] 

N/A 

N/A 

Socorro 

GPR 

2.22 

[2.01/2.43] 

2.08 

[1.87/2.29] 

2.53 

[2.28-2.79] 

2.51 

[2.27-2.75] 

2.52 

[2.26/2.80] 

EMI 

2.48 

[2.30/2.66] 

t 

2.79 

[2.62/2.97] 

2.46 

[2.28/2.64] 

3.28 

[3.10/3.46] 

IR 

2.77 

[2.58/2.96] 

N/A 

1.28 

[1.08/1.48] 

Tt 

2.16 

[1.94/2.37] 

Subsystem  produced  zero  false  alarms. 


Subsystem  had  no  detections,  but  at  least  one  false  alarm. 


FAR  (rrf2) 
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A  GDE 

•  GeoC 


Figure  IV-6.  P„  vs.  FAR  for  On-Road,  Subsurface  Mines  at  Socorro 

As  at  Aberdeen,  the  overall  detection  performance  of  the  contractors  is  lower  for 
low-  and  nonmetal  mines  than  for  metallic  mines.  Figure  IV-8  shows  the  Pd  versus  the 
FAR  for  the  different  types  of  mines. 


IV-8 


Figure  IV-7.  (a)  P„  vs.  P„,  and  (b)  the  d  Metric,  for  On-Road,  Subsurface  Mines  at  Socorro 

_  (a) 


0  0.01  0.02  0.03  0.04  0.05  0.06  0.07  0.08  0.09  0.1 


FAR  (nr2) 

Figure  IV-8.  Pd  vs.  FAR  for  (a)  Metal,  (b)  Low-Metal,  and  (c)  Nonmetal  Mines, 
On-Road,  Subsurface  at  Socorro 
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The  most  effective  detector  for  on-road,  subsurface  mines  at  Socorro  was  the 
GPR.  In  all  cases,  this  dominates  the  detections  as  well  as  the  false-alarm  rate  (see 
Figure  IV-9).  In  the  case  of  EG&G,  GDE,  and  GeoC,  the  EMI  and  IR  detectors  add  very 
little  improvement  in  detection  over  the  GPR  alone.  In  fact,  had  EG&G  and  GDE  not 
used  EMI  or  IR,  their  false-alarm  rates  would  have  improved  about  15  percent  and 
10  percent,  respectively.  CDC  and  CRC  could  not  have  achieved  their  near-90  percent  Pd 
without  other  detectors,  though  in  the  case  of  CDC  the  “cost”  of  these  detectors  is  about  a 
25-percent  increase  in  the  FAR  (all  of  CRC’s  FAR  is  due  to  the  GPR,  however). 


Figure  IV-9.  (a)  Pd  and  (b)  FAR  as  Functions  of  Sensor  Type  for  On-Road, 
Subsurface  Mines  at  Socorro 

By  using  the  ROC  curve  formalism  or  the  d  metric  (Figure  IV- 10  and  Table  IV-4) 
we  can  compare  the  performance  of  the  subsystems  at  Socorro.  CRC’s  and  CDC’s  GPR 
confidence  intervals  for  the  d  metric  in  Table  IV-4  overlapped,  but  seemed  to  outperform 
EG&G,  GDE,  and  GeoC.  CRC’s  EMI  system  had  zero  false  alarms  and  the  best  overall 
subsurface  performance  at  Socorro.  GeoC  exhibited  EMI  performance  that  is  better  (con¬ 
sidering  the  90-percent  confidence  interval)  than  CDC,  EG&G,  or  GDE.  Finally,  as  seen 
at  Aberdeen,  the  CDC  IR  outperformed  those  of  EG&G  and  GeoC  when  detecting  sub¬ 
surface  mines. 
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Figure  IV-10.  Pd  vs.  P„  for  (a)  GPR  Sensor,  (b)  EMI  Sensor,  and  (c)  IR  Sensors  for  On-Road, 
Subsurface  Mines  at  Socorro.  Note  that  is  on  a  log  scale;  therefore,  contractors  with  no 
false  alarms  for  a  particular  sensor  are  off  scale. 


B.  ON-ROAD,  SURFACE  MINES 


1.  Aberdeen  Results 

Figure  IV-11  shows  that  all  of  the  contractors  exceeded  the  0.90  detection 
probability  exit  criterion.  Only  CRC  also  met  the  FAR  criterion  as  well.  (See  Table  IV-5 
for  details.)  Interpreting  the  tradeoff  between  Pd  and  FAR  as  shown  in  Fig.  IV-11  is 
difficult,  so  we  turn  to  Fig.  IV-12  to  view  the  performances  against  isoperformance 
curves.  This  figure  shows  that  all  of  the  contractors  performed  nearly  along  the  same 
isoperformance  curve. 

Although  CRC  and  GDE  did  not  achieve  100-percent  detection  rate,  calculation 
of  the  d  metric  shows  that  the  90-percent  confidence  intervals  of  all  contractors  overlap. 

As  shown  in  Figure  IV- 13,  four  of  the  five  contractors  did  not  show  any  decrease 
in  detection  probability  as  the  metal  content  of  the  surface  mines  decreased.  CRC 
detected  all  surface  metal  mines  but  had  a  lower  probability  of  detecting  low-  and  non- 
metal  surface  mines. 
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Figure  IV-11.  Pd  vs.  FAR  lor  On-Road,  Surface  Mines  at  Aberdeen 
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Figure  IV-12.  Pd  vs.  P„,  for  On-Road,  Surface  Mines  at  Aberdeen 

For  surface  mines,  the  GPR  sensor  is  no  longer  the  best  performer  for  all  the 
contractors.  Figure  IV-14  shows  that  both  CDC’s  and  GeoC’s  IR  sensor  gave  the  best 
detection  performance  in  their  systems.  (Note  that  both  these  contractors  had  a  man-in- 
the-loop  in  the  processing  of  their  data.)  EG&G’s  IR  sensor  detected  almost  80  percent  of 
surface  mines. 
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Figure  IV-13.  Pd  vs.  FAR  for  (a)  Metal,  (b)  Low-Metal,  and  (c)  Nonmetal  Mines, 
On-Road,  Surface  at  Aberdeen 


Table  IV-5.  On-Road  Surface  Performance 


Aberdeen 

Socorro 

FAR 

P< 

#det./ 

FAR 

P< 

#det / 

Contractor 

(m-*) 

[Confidence] 

#enc. 

(m2) 

[Confidence] 

#enc. 

CDC 

0.054 

1.0 

86/86 

0.032 

1.0 

96/96 

[0.966/1.00] 

[0.969/1.00] 

CRC 

0.034 

0.919 

79/86 

0.037 

1.0 

96/96 

[0.852/0.962] 

[0.966/1.00] 

EG&G 

0.081 

1.0 

86/86 

0.043 

0.969 

93/96 

[0.966/1.00] 

[0.921/0.992] 

GDE 

0.068 

0.965 

83/86 

0.037 

1.0 

96/96 

[0.912/0.991] 

[0.966/1.00] 

GeoC 

0.056 

1.0 

86/86 

0.032 

1.0 

96/96 

[0.966/1.00] 

[0.966/1.00] 
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Figure  IV-14.  (a)  Pd  and  (b)  FAR  as  Functions  of  Sensor  Type  for  On-Road, 

Surface  Mines  at  Aberdeen 


2.  Socorro  Results 

As  shown  in  Figure  IV-15,  CDC,  CRC,  GDE,  and  GeoC  met  both  the  Pd  and  FAR 
exit  criteria  (they  all,  incidentally,  achieved  a  Pd  of  100  percent).  EG&G  met  the  P d  exit 
criterion  but  missed  the  FAR  criterion  by  less  than  3  percent. 
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Figure  IV-15.  Pd  vs.  FAR  for  On-Road,  Surface  Mines  at  Socorro 
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As  shown  in  Fig.  IV-16,  the  IR  sensor  is  CDC’s  strongest,  as  it  was  for  detecting 
surface  mines  at  Aberdeen.  For  GeoC  the  IR  was  not  as  robust  as  the  GPR  (which  is  re¬ 
verse  of  the  performance  on  surface  mines  at  Aberdeen),  although  the  IR  is  clearly  more 
effective  on  surface  mines  than  subsurface  mines  at  the  Socorro  site  (see  Figure  IV-9). 
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Figure  IV-16.  (a)  Pd  and  (b)  FAR  as  Functions  of  Sensor  Type  for  On-Road, 

Surface  Mines  at  Socorro 

C.  OFF-ROAD,  SUBSURFACE  MINES 

At  Aberdeen  the  contractors  surveyed  two  off-road  lanes  twice,  covering  a  total 
area  of  2,280.8  m2.  Within  the  mine  lanes  there  were  68  subsurface  mines  encountered. 
At  Socorro,  the  contractors  surveyed  seven  lanes  twice,  covering  a  total  area  of  537.5  m2, 
with  30  subsurface  mines  encountered.  On  this  site  the  total  area  of  the  mine  and  halo 
was  202.6  m2,  or  approximately  38  percent  of  the  test  lane.  Thus,  in  only  62  percent  of 
the  mine  lane  at  Socorro  was  there  an  opportunity  for  a  false  alarm.  At  Aberdeen,  the 
total  mine  area  was  442.2  m2,  which  constitutes  only  19  percent  of  the  test  site. 

1.  Aberdeen  Results 

The  off  road  exit  criteria  were  more  lenient:  Pd  must  be  greater  than  80  percent  for 
subsurface  mines,  while  FAR  must  be  less  than  0.17  m”2.  All  of  the  contractors  except 
CRC  met  both  the  Pd  and  FAR  criteria  (see  Figure  IV- 17).  CDC  appeared  to  be  the  best 
performer  in  these  off-road,  subsurface  conditions  at  Aberdeen  (see  Table  IV-6  for 
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details).  If  the  d  metric  is  used  (see  Figure  IV-18)  it  is  apparent  that  the  CDC  system 
performed  well,  but  the  d  metric  confidence  interval  overlaps  that  of  EG&G  and  overlaps 
just  slightly  that  of  GeoC.  It  is  worth  noting  that  the  errors  associated  with  the  d  metric 
are  large  because  the  number  of  mines  encountered  is  small  (only  68). 
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Figure  IV-17.  Pd  vs.  FAR  for  Off-Road,  Subsurface  Mines  at  Aberdeen 

Figure  IV- 19  shows  that  the  detection  performance  of  the  contractors  on 
subsurface  mines  diminishes  for  low-metal  mines,  which  is  consistent  with  the  results 
from  all  portions  of  this  ATD.  For  the  off-road,  subsurface  test  in  Aberdeen,  this  effect  is 
least  pronounced  with  CDC. 

Figure  IV-20  shows  that  the  GPR  sensor  once  again  was  the  best  performer,  in 
terms  of  P#  for  detecting  subsurface  mines  in  all  of  the  contractors’  systems  (also  see 
Table  IV-7).  The  other  sensors  did  add  to  the  detection  probability  of  the  contractors, 
except  for  the  GeoC  system,  where  the  EMI  and  IR  added  no  marginal  benefit  in  detec¬ 
tion  (but  also  did  not  contribute  to  the  false  alarms).  In  all  cases,  the  GPR  contributed  the 
bulk  of  the  false  alarms.  CDC  and  GeoC  exhibited  the  largest  GPR  Pd  (see  Table  IV-7). 
As  demonstrated  throughout  this  ATD,  CDC  had  superior  IR  performance.  In  addition, 
for  this  test,  both  EG&G  and  GeoC  showed  robust  EMI  performance.  Table  IV-8 
summarizes  the  d  metric  for  the  off-road,  subsurface  condition. 
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Table  IV-6.  Off-Road  Subsurface  Performance 


Aberdeen 

Socorro 

FAR 

P* 

#det./ 

FAR 

P< 

#det / 

Contractor 

(m2) 

[Confidence] 

#enc. 

(m2) 

[Confidence] 

#enc. 

CDC 

0.050 

0.985 

67/68 

0.048 

0.633 

19/30 

[0.931/0.999] 

[0.466/0.779] 

CRC 

0.201 

0.912 

62/68 

0.041 

0.733 

22/30 

[0.833/0.962] 

[0.569/0.860] 

EG&G 

0.099 

0.956 

65/68 

0.058 

0.700 

21/30 

[0.890/0.988] 

[0.534/0.834] 

GDE 

0.085 

0.912 

62/68 

0.065 

0.800 

24/30 

[0.833/0.962] 

[0.642/0.910] 

GeoC 

0.066 

0.897 

61/68 

0.035 

0.700 

21/30 

[0.815/0.951] 

[0.534/0.834] 
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Figure  IV-18.  The  d  Metric  for  Off-Road,  Subsurface  Mines  at  Aberdeen 
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Table  IV-7.  Detection  Rate  and  90-Percent  Confidence  Intervals 
for  Each  Sensor,  Off-Road,  Subsurface 


Site 

Sensor 

Aberdeen 

0.926 

[0.851/0.971] 

0.779 

[0.680/0.859] 

0.897 

[0.815/0.951] 

0.441 

[0.338/0.548] 

IR 

0.838 

[0.746/0.907] 

0.456 

[0.352/0.563] 

0.412 

[0.310/0.519] 

Socorro 

0.700 

[0.534/0.834] 

0.533 

[0.369/0.692] 

IR 

0.267 

[0.140/0.431] 

0.100 

[0.027/0.239] 

Table  IV-8.  d  metric  with  Confidence  Intervals  for  Each  Sensor,  Off-Road,  Subsurface 


Site 

Sensor 

CRC 

GPR 

2.48 

[2.07/2.93] 

1.67 

[1.37/1.98] 

1.66 

[1.35/1.97] 

1.15 

[0.87/1.42] 

2.04 

[1.67/2.43] 

Aberdeen 

EMI 

1.76 

[1.49/2.04] 

1.80 

[1.53/2.07] 

2.38 

[2.11/2.65] 

1.84 

[1.56/2.11] 

2.54 

[2.27/2.81] 

IR 

[2.51/3.17] 

1.44 

[1.17/1.71] 

1.44 

[1.17/1.71] 

GPR 

1.32 

[0.90/1.74] 

1.63 

[1.18/2.06] 

1.36 

[0.93/1.78] 

1.71 

[1.223/2.21] 

1.65 

[1.21/2.09] 

Socorro 

EMI 

2.24 

[1.82/2.66] 

IR 

0.54 

[0.08/0.99] 

0.23 

[-0.41/0.80] 

1.  Socorro  Results 

At  Socorro,  only  GDE  met  both  the  off-road  Pd  and  FAR  exit  criteria  for 
subsurface  mines  (see  Figure  IV-21).  The  remaining  four  contractors  were  within  the 
FAR  criterion  but  missed  on  Pd.  It  is  difficult  to  determine  a  best  performance  in  these 
conditions — even  when  viewing  the  Pd  vs.  Pfa  plot  (not  shown  here),  no  single  contractor 
emerges  as  a  standout.  It  is  interesting  to  note  that  the  range  of  contractors’  FAR  in  the 
off-road  lane  at  Socorro  was  much  wider  than  the  on-road  lanes  (as  expected),  while  it 
was  smaller  than  in  the  off-road  lane  at  Aberdeen. 
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FAR  (rrf2) 

Figure  IV-21.  Pdvs.  FAR  for  Off-Road,  Subsurface  Mines  at  Socorro 

Figure  IV -22  unequivocally  shows  the  problem  in  these  off-road  conditions:  all  of 
the  contractors  had  difficulties  detecting  low-metal  mines,  while  the  metal  mines  posed 
no  problem  at  all.  Detecting  low-metal,  subsurface  mines  at  Socorro  became  more 
difficult  offroad:  a  typical  Pd  on  road  was  80  percent,  while  off  road  it  fell  to  about  40 
percent.  Also  note  the  higher  Pd  (about  80  percent  or  more)  for  low-metal,  subsurface 
mines  at  the  off-road  Aberdeen  lanes.  It  seems  that  the  off-road  conditions  at  Socorro 
posed  a  difficult  challenge  for  low-metal,  subsurface  mine  detection. 

Figure  IV-23  shows  that  CDC’s  and  CRC’s  highest  detection  probability  was 
achieved  with  their  EMI  detectors,  which  is  different  from  their  performances  in  other 
conditions  of  this  ATD.  This  may  be  due  to  the  challenging  environment  of  Socorro’s 
soil  for  GPR  sensors. 

D.  OFF-ROAD,  SURFACE  MINES 

1.  Aberdeen  Results 

CDC,  GeoC,  GDE,  and  EG&G  met  the  off-road  Pd  and  FAR  exit  criteria  for 
surface  mines  (see  Fig.  IV-24).  CDC  achieved  excellent  performance  in  this  category,  as 
they  had  the  same  Pd  as  GeoC  but  had  a  FAR  that  was  about  two-thirds  as  large.  CRC  met 
the  Pd  criterion  but  missed  the  FAR  exit  criterion. 
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Figure  IV-24.  Pd  vs.  FAR  for  Off-Road,  Surface  Mines  at  Aberdeen 

Figure  IV-25  shows  that  for  all  contractors,  Pd  decreased  when  detecting  low- 
metal  mines.  Note  that  this  degradation  was  not  evident  in  the  on-road  condition  at  Aber¬ 
deen  (cf.  with  Fig.  IV-13),  implying  that  the  off-road  condition  is  more  challenging  for 
the  detection  of  surface  mines. 

Again,  the  IR  sensors  performed  well  at  detecting  surface  mines.  Figure  IV-26 
shows  that  the  IR  sensor  was  comparable  to  the  GPR  for  CDC,  EG&G,  and  GeoC.  The 
IR  sensor  had  a  lower  contribution  to  false  alarms  than  the  GPR  for  the  four  contractors 
that  used  both  sensors. 


2.  Socorro  Results 

As  shown  in  Figure  IV-27,  all  contractors  met  the  exit  criteria  for  off-road, 
surface  mines  at  Socorro.  All  contractors  achieved  a  detection  probability  of  1;  the  GeoC 
FAR  (0.035  nT2)  was  the  lowest  of  the  five  contractors. 
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Figure  IV-25.  Pdfor  (a)  Metal  Mines  and  (b)  Low-Metal  Mines,  Off-Road, 

Surface  at  Aberdeen 
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Figure  IV-26.  (a)  Pd  and  (b)  FAR  as  Functions  of  Sensor  Type  for  Off-Road, 

Surface  Mines  at  Aberdeen 
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Figure  IV-27.  Pdv s.  FAR  for  Off-Road,  Surface  Mines  at  Socorro 
E.  POSITION  RESOLUTION 

In  this  section,  we  compare  the  position  resolutions  (standard  deviations,  or  RMS, 
of  the  miss  distance  distributions)  achieved  by  the  contractors.  For  information  regarding 
the  method  we  use  to  measure  the  RMS  resolutions,  see  the  discussion  in  Chapter  III.  For 
more  detailed  analyses  of  the  contractors’  position  resolutions,  including  a  breakdown  of 
resolution  for  the  different  sensor  types,  see  the  individual  contractor  performance 
summaries  in  Chapter  V. 

Figure  IV-28  shows  the  along-track  and  cross-track  resolutions  at  Aberdeen  in 
both  the  on-road  and  off-road  lanes.  Contractors  typically  recorded  along-  and  cross-track 
resolutions  between  10  and  30  cm;  however,  GDE  recorded  almost  a  50-cm  cross-track 
resolution  in  the  off-road  lanes  at  Aberdeen,  and  CRC  posted  just  over  a  30-cm  cross¬ 
track  resolution  in  the  off-road  lane  at  Aberdeen.  Note  that  there  is  a  trend  for  the 
contractors  to  slightly  lose  resolution  (obtain  larger  RMS)  as  they  go  off  road.  This  trend, 
however,  is  not  universal:  EG&G  and  GeoC  did  exhibit  better  along-track  resolutions  off 
road.  No  single  contractor  stands  out  as  having  the  best  overall  resolution  at  Aberdeen. 

Figure  IV-29  is  a  summary  of  the  contractors’  position  resolutions  at  the  Socorro 
test  site.  All  the  resolutions  were  between  about  10  and  30  cm,  with  some  contractors 
consistently  achieving  about  10-cm  to  15-cm  resolutions.  No  trend  is  evident  between  the 
on-road  and  off-road  conditions. 
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Figure  IV-28.  Along-Track  and  Cross-Track  Position  Resolution  (RMS) 
for  On-Road  and  Off-Road  Lanes  at  Aberdeen 
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Figure  IV-29.  Along-Track  and  Cross-Track  Position  Resolution  (RMS)  for  On-Road 
and  Off-Road  Lanes  at  Aberdeen  and  Off-Road  Lanes  at  Socorro 

A  sensor  will  only  lose  about  0.3  percent  of  its  detection  probability  if  its  along- 
track  or  cross-track  declarations  are  required  to  be  within  a  distance  that  extends  three 
times  the  RMS  position  resolution  from  the  center  of  a  mine  (assuming  there  is  no  bias). 
Thus,  if  a  sensor  has  a  20-cm  resolution,  the  requirement  that  a  declaration  be  placed 
within  60  cm  from  the  center  of  a  mine  (or,  equivalently  in  this  ATD,  reducing  the  halo 
size  to  45  cm)  would  have  almost  no  effect  on  Pd.  Since  a  20-cm  resolution  is  reasonably 
representative  of  the  contractors’  average  performance,  we  can  state  that  the  current 
grading  criterion — a  1-m  halo  from  the  edge  of  a  mine  (which  corresponds  to  about  a 
1.15-m  requirement  from  the  center  of  an  AT  mine) — is  too  large.  If  a  smaller  halo  were 
chosen,  most  of  the  contractors  in  this  ATD  would  have  had  about  the  same  Pd 
performance.  Using  a  smaller  halo  may  increase  the  FAR  as  defined  in  this  report,  but  the 
false  alarm  probability  P/a,  which  properly  accounts  for  the  areal  opportunity  for  false 
alarms,  would  not  increase. 
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F.  COMBINED  ABERDEEN  AND  SOCORRO  RESULTS 

In  this  section  we  study  the  contractors’  performance  using  the  combined  results 
of  the  Aberdeen  and  Socorro  tests. 

1.  On-road,  Subsurface  Mines 

As  shown  in  Figure  IV-30,  none  of  the  contractors  strictly  met  the  EMD  exit 
criteria  for  on-road,  subsurface  mines  using  the  combined  data  from  Aberdeen  and 
Socorro.  CRC  was  statistically  consistent  within  the  criteria:  it  met  the  FAR  criterion  and 
was  within  statistical  error  of  the  Pd  criterion  (CRC  had  the  lowest  Pd  of  the  five  contrac-. 
tors).  CDC  and  GeoC  both  met  the  Pd  criterion  and  were  within  about  5  percent  of  the 
FAR  criterion.  GDE  and  EG&G  met  the  Pd  criterion,  but  were  further  away  from  the  FAR 
criterion. 


x  CDC 
4  CRC 
"  EG&G 
A  GDE 
*  GeoC 


Figure  IV-30.  Pdv s.  FAR  for  On-Road,  Subsurface  Mines  at  Aberdeen  and  Socorro 

(Combined) 


2.  On-road,  Surface  Mines 

Figure  IV-31  shows  the  Pd  vs.  FAR  results  for  on-road,  surface  mines  for  the 
combined  tests  of  Aberdeen  and  Socorro.  CRC,  while  posting  the  lowest  Pd  of  the  five 
contractors,  was  the  only  contractor  that  met  Pd  and  FAR  exit  criteria  outright.  CDC  and 
GeoC,  both  of  which  achieved  100-percent  P#  missed  the  FAR  criterion  by  less  than 
5  percent.  GDE  and  EG&G,  both  of  which  achieved  a  Pd  of  over  98  percent,  missed  the 
FAR  criterion  by  wider  margins. 
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Figure  IV-31 .  Pd  vs.  FAR  for  On-Road,  Surface  Mines  at  Aberdeen  and  Socorro  (Combined) 


3.  Off-road,  Subsurface  Mines 

Figure  IV-32  shows  the  Pd  vs.  FAR  results  for  off-road,  subsurface  mines  for  the 
combined  tests  of  Aberdeen  and  Socorro.  Note  that  CDC,  EG&G,  GDE,  and  GeoC  all 
met  the  Pd  and  FAR  exit  criteria.  One  contractor,  CRC,  missed  these  exit  criteria — 
although  its  Pd  passed  the  criterion,  the  FAR  missed  the  criterion  by  less  than  1  percent. 


4.  Off-road,  Surface  Mines 

Figure  IV-33  shows  the  Pd  vs.  FAR  results  for  off-road,  surface  mines  for  the 
combined  tests  of  Aberdeen  and  Socorro.  CDC,  GeoC,  EG&G,  and  GDE  met  both  the  Pd 
and  FAR  criteria.  CRC  met  the  Pd  criterion  but  missed  the  FAR  criterion  by  1  percent. 
CDC  and  GeoC  achieved  Pd  of  100  percent  with  only  about  one-third  of  the  false  alarms 
allowed  by  the  exit  criterion.  GDE  and  EG&G  were  about  in  the  middle  of  the  Pd  and 
FAR  ranges  allowed  by  the  exit  criteria. 
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Figure  IV-32.  Pd  vs.  FAR  for  Off-Road,  Subsurface  Mines 
at  Aberdeen  and  Socorro  (Combined) 


Figure  IV-33.  Pd  vs.  FAR  for  Off-Road,  Surface  Mines 
at  Aberdeen  and  Socorro  (Combined) 


G.  VEHICLE  SPEED 

Table  IV-9  shows  the  average  vehicle  speeds  (also  called  detection  speeds  in  this 
report)  of  the  five  contractors  at  Aberdeen  and  Socorro  for  both  on-road  and  off-road 
lanes.  EG&G  did  not  include  time-stamps  in  its  electronic  alarm  files,  and  so  we  could 
not  compute  the  detection  speed  of  their  system. 
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Table  IV-9.  System  Detection  Speed  at  Aberdeen  and  Socorro 


Aberdeen 

Socorro 

On-Road  Speed 

Off-Road  Speed 

On-Road  Speed 

Off-Road  Speed 

Contractor 

(km/hr) 

(km/hr) 

(km/hr) 

(km/hr) 

CDC 

0.616 

0.689 

0.507 

0.309 

CRC 

1.472 

1.190 

1.097 

0.887 

EG&G 

N/A 

N/A 

N/A 

N/A 

GDE 

1.699 

1.278 

1.233 

1.229 

GeoC 

1.114 

0.859 

1.183 

1.057 

None  of  the  contractors  met  the  detection  speed  exit  criteria  of  3.6  km/hr  for  on¬ 
road  and  2.0  km/hr  for  off-road.  For  each  contractor  at  both  sites,  off-road  speeds  were 
less  than  on-road  speeds.  GDE  was  the  fastest  at  both  sites,  both  on  and  off  road.  CDC 
was  the  slowest,  with  speeds  less  than  one-half  those  of  the  other  contractors.  This  was 
probably  a  result  of  their  TNA  verification  system,  which  required  the  vehicle  to  stop 
periodically  for  approximately  2-3  minutes. 


IV-29 


V.  INDIVIDUAL  CONTRACTOR  PERFORMANCE 


In  this  section  we  examine  in  detail  the  systems  employed  by  each  contractor.  We 
are  especially  concerned  with  which  sensors  are  dominant  on  each  system,  and  how  the 
other  sensors  on  board  provide  marginal  improvements  to  the  entire  system.  In  addition, 
we  look  at  how  the  sensors  perform  against  mines  of  varying  metal  content,  as  well  as  the 
position  resolution  of  the  sensors.  Finally,  we  report  the  results  of  special  runs  completed 
by  each  of  the  contractors. 

A.  CDC  PERFORMANCE 

1.  Individual  Sensor  and  Sensor  Pair  Performance 

As  shown  in  Table  V-l,  CDC’s  system  found  100  percent  of  the  on-road  and  off¬ 
road  surface  mines  emplaced  at  Aberdeen  and  Socorro.  Subsurface  mines  were  detected 
by  its  system  at  about  a  90-percent  level  or  above,  except  for  the  off-road  lane  at  Socorro, 
where  the  Pd  was  about  63  percent. 

CDC’s  GPR  made  the  bulk  of  the  subsurface  detections,  except  for  the  off-road 
lane  at  Socorro,  where  the  EMI  sensor  made  most  of  the  detections.  CDC’s  IR  sensor  was 
the  most  effective  for  detecting  surface  mines,  although  the  GPR  was  as  good,  both  off¬ 
road  at  Aberdeen  and  on-road  at  Socorro. 

CDC’s  GPR  was  usually  responsible  for  the  bulk  of  its  false  alarms,  except  for  the 
off-road  lane  at  Socorro,  where  the  IR  contributed  the  largest  number  to  the  system  total. 

Even  though  CDC’s  GPR  typically  achieved  the  best  detection  probability  of  any 
single  sensor  in  its  system,  there  were  improvements  in  the  system  performance  due  to 
the  other  sensors.  In  fact,  no  single  pair  of  sensors  stood  out  as  being  responsible  for  the 
total  system  performance.  For  example,  in  most  cases  the  GPR  and  IR  alone  performed  as 
well  as  the  entire  system  (within  errors);  however,  in  the  off-road,  subsurface  condition  at 
Socorro,  the  EMI  in  conjunction  with  the  GPR  was  needed  to  achieve  the  results  CDC 
posted. 
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Table  V-1.  CDC’s  False-Alarm  Rates  and  Detection  Probabilities  Listed  for  individual 
Sensors,  Sensor  Pairs,  and  the  Total  System.  Results  from  the  Aberdeen 
and  Socorro  Sites  are  listed  separately.  False  alarm  rates  are  quoted 
in  the  units  m"2,  and  detection  probabilities  are  given  in  percent. 

G,  M,  and  I  refer  to  the  GPR,  EMI,  and  IR  sensors,  respectively. 


CDC 


Aberdeen 

G 

M 

1 

GM 

Ml 

Gl 

TOTAL 

on-road  FAR 

0.039 

0.029 

0.012 

0.053 

0.045 

0.054 

on-road,  subsurface  Pd 

90.9 

60.6 

72 

93.2 

87.1 

92.4 

93.2 

on-road,  surface  Pd 

94.2 

62.8 

100 

96.5 

100 

100 

100 

off  road  FAR 

0.04 

0.021 

0.008 

0.049 

0.027 

0.041 

0.05 

off-road,  subsurface  Pd 

92.7 

64.7 

83.8 

94.1 

88.2 

98.5 

98.5 

off-road,  surface  Pd 

100 

60.4 

100 

100 

100 

100 

100 

Socorro 

G 

M 

1 

GM 

Ml 

Gl 

TOTAL 

on-road  FAR 

0.024 

0.013 

0.012 

0.032 

0.022 

0.027 

0.032 

on-road,  subsurface  Pd 

81.1 

58.8 

69.6 

88.5 

85.8 

86.5 

89.2 

on-road,  surface  Pd 

97.9 

50 

99 

97.9 

100 

100 

100 

off  road  FAR 

0.022 

0.007 

0.035 

0.037 

0.048 

0.048 

off-road,  subsurface  Pd 

46.7 

56.7 

26.7 

63.3 

56.7 

50 

63.3 

off-road,  surface  Pd 

88.9 

66.7 

100 

88.9 

100 

100 

100 

2.  Detection  Probability  Versus  Metal  Content  of  Mine 

Table  V-2  summarizes  CDC’s  detection  probability  versus  metal  content,  for  on 
and  off  road,  surface  and  subsurface  conditions.  The  detection  probability  is  given  for  all 
sensors,  as  well  as  for  individual  sensor  types. 


Table  V-2.  CDC’s  Detection  Probability  vs.  Metal  Content  at  Aberdeen  and  Socorro 


CDC/Aberdeen 

On  Road 

Off  Road 

ALL 

GPR  I  EMI  1 

IR 

ALL 

GPR 

4- 

EMI 

IR 

M 

1 

0.94  !  1  j 

1 

1 

1 

• 

i 

1 

1 

Surface 

LM 

1 

0.93  I  0.39  T 

1 

1 

1 

i 

i 

0.21 

1 

NM 

1 

1  i  0.17  i 

1 

na 

na 

i 

i 

i 

na 

na 

M 

1 

0.98  j  0.98  j 

0.73 

1 

0.97 

I 

i 

i 

0.95 

Subsurface 

LM 

0.86 

0.83  i  0.28  ! 

0.69 

0.97  | 

|  0.87 

*"  i 
■ 

0.7 

NM 

T"h 

1  •  0.17  | 

i 

na  ! 

na 

r 

■ 

i 

na  | 

na 

CDC/Socorro 

On  Road 

Off  Road 

ALL 

GPR 

EMI  | 

IR 

ALL 

GPR 

EM! 

IR 

M 

1 

1 

1  i 

0.98 

1 

1 

1 

1 

Surface 

LM 

1 

0.96 

0  T 

1 

1 

0.67 

0 

1 

NM 

na 

na 

na  i 

na 

na 

0 

_ 02 _ , 

na 

M 

1 

0.9 

1  i 

0.74 

1 

0.69 

1 

0.44 

Subsurface 

LM 

0.78 

0.72 

0.22  j 

0.63 

0.21 

j _ 9:?J _ ] 

0.07 

!  0.07 

NM 

0.86 

0.79 

0.21  t 

0.79 

na 

f 

\  na 

na 

|  na 

All  metal-cased  mines  were  found  by  CDC,  regardless  of  the  depth  of  the  mine 
and  the  test  location.  Their  EMI  sensor  was,  on  average,  the  best  sensor  for  finding  the 
metal  mines.  The  GPR  performed  well  at  detecting  metal  mines,  except  in  the  off-road, 
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subsurface  condition  at  Socorro.  The  IR  sensor  was  very  reliable  at  detecting  surface 
metal  mines,  but  showed  a  degradation  of  performance  for  subsurface  metal  mines. 

Low-metal,  surface  mines  were  detected  with  a  higher  probability  than  low-metal, 
subsurface  mines.  The  GPR  sensor  was  the  best  sensor  for  the  detection  of  low-metal 
mines,  averaged  over  all  conditions,  although  the  IR  sensor  performed  about  as  well  as 
the  GPR  for  the  surface  condition. 

3.  Position  Resolution 

a.  On-Road  Tests 

Figure  V-l  shows  CDC’s  miss-distance  distributions  in  the  on-road  tests  at 
Aberdeen.  The  mean  (bias)  of  the  along-track  distribution  is  -4  cm  (meaning  that  the 
mine  locations  were  offset  by  an  average  of  4  cm  from  the  center  of  the  mine);  however, 
this  bias  is  not  especially  significant  because  it  is  well  within  the  radius  of  the  mine.  The 
RMS  resolution  along-track  is  13  cm.  Cross-track,  the  mean  is  0  cm  (that  is,  unbiased) 
and  the  standard  deviation  (RMS)  is  17  cm.  These  distributions  were  typical  for  CDC  at 
both  Aberdeen  and  Socorro. 

Table  V-3  summarizes  the  bias  and  RMS,  broken  down  by  surface  and  subsurface 
mines,  as  well  as  by  sensor,  for  the  on-road  tests  at  Aberdeen  and  Socorro.  The  data  show 
there  are  no  significant  trends;  that  is,  no  sensor  performed  significantly  differently  from 
the  overall  performance  of  all  sensors,  nor  was  there  a  dependence  on  mine  location 
(surface  or  subsurface).  In  addition,  CDC’s  performance  did  not  differ  significantly  at 
Aberdeen  or  Socorro. 


meter  meter 


Figure  V-1.  CDC’s  Miss-Distance  Distributions  for  Surface  and  Subsurface  Mines  in  On 
Road  Tests  at  Aberdeen.  Data  points  include  the  GPR,  EMI,  and  IR  sensors. 

The  solid  curve  is  the  best  fit  of  a  constant  plus  a  Gaussian. 
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Table  V-3.  CDC  Bias  and  Resolution  Performance  on  Road  at  Aberdeen  and  Socorro 


Aberdeen  Position  Resolution 

Socorro  Position  Resolution 

Type 

Along-track 

Cross-track 

Along-track 

Cros 

s-track 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

All  sensors, 
subsurface  +  surface 

-0.04 

0.13 

0.00 

0.17 

-0.03 

0.15 

-0.04 

0.16 

All  sensors, 
subsurface 

-0.03 

0.14 

-0.02 

0.12 

0.01 

0.13 

-0.02 

0.15 

GPR 

-0.01 

0.15 

-0.02 

0.13 

0.02 

0.13 

-0.03 

0.15 

EMI 

-0.03 

0.14 

-0.02 

0.11 

0.05 

0.11 

-0.04 

0.15 

IR 

-0.05 

0.12 

-0.02 

0.11 

0.00 

0.15 

-0.01 

0.15 

All  sensors,  surface 

-0.04 

0.11 

0.02 

0.20 

-0.06 

0.13 

-0.07 

0.15 

GPR 

-0.03 

0.11 

0.02 

0.19 

-0.06 

0.13 

-0.06 

0.14 

EMI 

-0.09 

0.10 

0.04 

0.18 

-0.09 

0.15 

-0.07 

0.12 

IR 

-0.04 

0.11 

0.02 

0.18 

-0.06 

0.13 

-0.07 

0.13 

b.  Off-Road  Tests 

Figure  V-2  shows  the  combined  results  for  the  measured  mine  locations  in  the 
off-road  tests  at  Aberdeen  for  CDC.  Along-track,  the  mean  (bias)  of  the  distribution  is 
-12  cm,  which  appears  to  be  slightly  biased.  That  is,  in  this  off-road  case,  the  measured 
mine  location  is  typically  several  centimeters  behind  the  actual  location  of  the  center  of 
the  mine,  with  respect  to  the  vehicle’s  direction  of  travel.  The  intrinsic  resolution  along- 
track  is,  however,  consistent  with  the  on-road  test,  at  14  cm.  The  cross-track 
measurements  again  appear  to  have  no  bias,  and,  at  20  cm,  the  standard  deviation  is 
consistent  with  the  on-road  tests. 

This  slight  bias  in  the  along-track  off-road  test  appears  to  be  primarily  due  to  the 
performance  of  the  EMI  sensor  (see  Table  V-4).  Also  shown  in  the  table  are  the  resolu¬ 
tions  for  the  off-road  tests  at  Socorro.  There  were  poor  statistics  at  this  test,  although  it  is 
apparent  in  the  table  that  the  bias  caused  by  the  EMI  detector  (as  in  the  off-road 
Aberdeen  test)  was  not  present.  The  larger  intrinsic  resolution  at  Socorro  is  not 
particularly  statistically  significant  here  because  too  few  data  points  were  collected. 
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CDC:  Off-Road,  Along-Track  Positions 


CDC:  Off-Road,  Across-Track  Positions 


Figure  V-2.  Results  of  the  Surface  and  Subsurface  Measured  Mine  Locations 
for  the  CDC  Off-Road  Tests  at  Aberdeen.  Data  from  the  GPR,  EMI, 
and  IR  sensors  are  included  in  this  plot. 


4.  Pd  and  Rh>w 

The  bias  and  RMS  resolution  performance  of  the  sensors  affect  how  well,  as  a 
function  of  i?halo,  CDC’s  system  detects  the  mines.  Figure  V-3  shows  a  plot  of  Pd  versus 
f?halo  for  the  tests  at  Aberdeen  and  Socorro.  These  figures  summarize  the  overall  implica¬ 
tion  of  CDC’s  relatively  small  sensor  bias  and  intrinsic  sensor  resolution  (as  tabulated  in 
section  2). 

As  shown  in  the  plots,  the  detection  probability  for  CDC’s  sensors  reached  its 
maximum  for  an  f?halo  of  much  less  than  1  m.  If  this  ATD  had  required  i?hal0  to  be  as  small 
as  approximately  40  cm,  then  CDC’s  Pd  performance  would  have  been  nearly  the  same. 
Even  an  i?halo  of  as  small  as  25  cm  would  have  resulted  in  very  little  degradation  of 
performance,  and  CDC  would  likely  have  still  met  most  of  the  Pd  exit  criteria. 
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Table  V-4.  CDC  Bias  and  Resolution  Performance  off  Road  at  Aberdeen  and  Socorro 


Aberdeen  Position  Resolution 

Socorro  Position  Resolution 

Type 

Along-track 

Cross-track 

Along-track 

Cross-track 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

All  sensors, 

subsurface  +  surface 

-0.12 

0.14 

-0.03 

0.20 

-0.08 

0.22 

All  sensors, 

subsurface 

-0.14 

0.14 

-0.01 

0.21 

-0.02 

0.16 

GPR 

-0.13 

0.14 

-0.02 

0.19 

0.06 

0.19 

-0.08 

0.15 

EMI 

-0.19 

0.09 

0.03 

0.19 

0.00 

0.22 

0.01 

0.15 

IR 

-0.10 

0.15 

-0.02 

0.21 

-0.07 

0.20 

0.02 

0.16 

All  sensors,  surface 

-0.07 

0.14 

-0.05 

0.19 

Not 
well  fit 

Not  well 
fit 

Not 
well  fit 

Not  well 
fit 

GPR 

-0.02 

0.11 

-0.05 

0.15 

Not 
well  fit 

Not  well 
fit 

-0.12 

0.19 

EMI 

-0.15 

0.10 

-0.02 

0.19 

Not 
well  fit 

Not  well 
fit 

-0.09 

0.24 

IR 

-0.07 

0.14 

-0.06 

0.21 

Not 
well  fit 

Not  well 
fit 

Not 
well  fit 

Not  well 
fit 

CDC 


0  0.2  0.4  0.6  0.8  1 


0  0.2  0.4  0.6  0.8  1 

Rfcalo  (m) 


0  0.2  0.4  0.6  0.8  1 


0  0.2  0.4  0.6  0.8  1 


Rhalo  (m) 


-  Subsurface 

-  Surface 


c)  Off-road  at  Aberdeen 


d)  Off-road  at  Socorro 


Figure  V-3.  Pd  vs.  Rhal0  for  CDC’s  Sensor  Suite  at  Aberdeen  and  Socorro 
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5.  Additional  Runs 


a.  Aberdeen  Results 

The  only  additional  runs  by  CDC  at  Aberdeen  were  the  two  night  runs  conducted 
on  lane  15.1  Table  V-5  shows  the  cumulative  Pd  and  FAR  for  the  scored  on-road,  day  runs 
and  the  night  runs  on  lane  15.  The  Pd  and  FAR  are  shown  for  all  sensors  (Total)  and  for 
the  IR  sensor  only.  The  reason  for  presenting  the  results  for  the  night  runs  in  this  way  is 
because  we  expect  the  IR  will  be  the  only  sensor  that  behaves  differently  at  night.  In 
Table  V-5,  we  notice  that  the  Pd  for  subsurface  mines  for  the  night  runs  is  less  than 
during  the  day,  while  IR  surface  detections  are  unaffected  at  night.  The  total  and  IR  FARs 
for  the  night  runs  are  nearly  the  same  as  the  FARs  for  the  day  runs. 

Table  V-5.  Comparison  of  CDC  On-Road  Day  and  Night  Runs  at  Aberdeen 


On-Road  Day 

Night 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.932 

1.0 

0.975 

IR  Pd 

1.0 

0.720 

1.0 

0.600 

Total  FAR 

0.054  m'2 

0.055  nrf2 

IR  FAR 

0.012  m’2 

0.012  m“2 

b.  Socorro  Results 

The  only  additional  runs  by  CDC  at  Socorro  were  the  one  night  run  conducted  on 
lane  11  and  the  two  night  runs  conducted  on  lane  13. 2  The  cumulative  Pjs  and  FARs  for 
the  scored  on-road  day  runs  and  the  night  runs  on  lanes  1 1  and  15  are  shown  in  Table  V- 
6.  The  results  are  different  from  Aberdeen.  The  IR  Pd  for  subsurface  mines  is  larger  at 
night  than  during  the  day,  while  surface  detections  are  not  different  in  the  day  and  night. 
In  fact,  the  IR  sensor  detected  all  the  subsurface  mines  detected  during  the  night  runs.  It 


1  The  results  of  these  runs  are  summarized  in  Table  B-8  in  Appendix  B  and  can  be  compared  to  the 
results  CDC  obtained  on  its  scored  daytime  runs  on  lane  15  as  shown  in  Table  B-5. 

2  The  results  of  these  runs  are  summarized  in  Tables  B-22  and  B-24  in  Appendix  B  and  can  be  compared 
to  the  results  CDC  obtained  on  its  scored  daytime  runs  on  lanes  1 1  and  13  as  shown  in  Tables  B-13 
and  B-15,  respectively. 
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should  be  noted  that  the  total  and  IR  FAR  at  night  was  about  twice  the  FAR  of  the  day 
runs. 


Table  V-6.  Comparison  of  CDC  On-Road  Day  and  Night  Runs  at  Socorro 


On-Road  Day 

Night 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.903 

0.990 

0.903 

Total  FAR 

0.032  m'2 

0.058  rrf2 

IR  FAR 

0.012  m-2 

0.026  m'2 

B.  CRC  PERFORMANCE 

1.  Individual  Sensor  and  Sensor  Pair  Performance 

As  shown  in  Table  V-7,  CRC’s  GPR  detected  more  surface  mines  than  its  EMI 
sensor,  regardless  of  condition.  It  also  detected  most  of  the  subsurface  mines,  except  on 
the  off-road  lane  at  Socorro,  where  its  EMI  sensor  detected  the  bulk  of  the  mines.  CRC 
did  not  utilize  its  IR  detector  in  these  tests. 

The  GPR  dominated  the  false-alarm  rate  in  all  cases.  The  EMI  sensor  had  no  false 
alarms  at  Socorro,  either  on-  or  off-road,  and  at  its  worst  contributed  0.018  m~2  to  the 
false-alarm  rate  off  road  at  Aberdeen  (which  represented  less  than  10  percent  of  the 
GPR’s  FAR). 

It  was  the  combination  of  sensors  that  enabled  the  CRC  system  to  achieve  the 
results  that  they  posted;  neither  the  GPR  nor  the  EMI  sensor  would  have  performed  as 
well  on  its  own  under  most  conditions. 

2.  Detection  Probability  Versus  Metal  Content  of  Mine 

Table  V-8  summarizes  CRC’s  detection  probability  versus  metal  content,  for  on 
and  offroad,  surface  and  subsurface  conditions.  The  detection  probability  is  given  for  all 
sensors,  as  well  as  for  individual  sensor  types. 
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Table  V-7.  CRC’s  False-Alarm  Rates  and  Detection  Probabilities  Listed  for  Individual 
Sensors,  Sensor  Pairs,  and  the  Total  System.  Results  from  the  Aberdeen  and 
Socorro  sites  are  listed  separately.  False-alarm  rates  are  quoted  in  the  units 
m'2,  and  detection  probabilities  are  given  in  percent.  G,  M,  and  I  refer 
to  the  GPR,  EMI,  and  IR  sensors,  respectively. 


Aberdeen 

G 

M 

1 

GM 

Ml 

Gl 

TOTAL 

on-road  FAR 

0.031 

0.003 

na 

0.034 

na 

na 

0.034 

on-road,  subsurface  Pd 

47.7 

na 

77.3 

na 

na 

77.3 

on-road,  surface  Pd 

40.7 

na 

91.9 

na 

na 

91.9 

off  road  FAR 

0.183 

0.018 

na 

0.201 

na 

na 

0.201 

off-road,  subsurface  Pd 

77.9 

58.8 

na 

91.2 

na 

na 

off-road,  surface  Pd 

89.6 

56.3 

na 

95.8 

na 

na 

Socorro 

G 

M 

i 

GM 

Ml 

Gl 

TOTAL 

on-road  FAR 

0 

na 

0.037 

na 

na 

0.037 

on-road,  subsurface  Pd 

47.3 

na 

90.5 

na 

na 

90.5 

on-road,  surface  Pd 

100 

50 

na 

na 

na 

100 

off  road  FAR 

0 

na 

0.041 

na 

na 

0.041 

off-road,  subsurface  Pd 

30 

53.3 

na 

73.3 

na 

na 

73.3 

off-road,  surface  Pd 

100 

66.7 

na 

100 

na 

na 

100 

Table  V-8.  CRC’s  Detection  Probability  vs.  Metal  Content  at  Aberdeen  and  Socorro 


CRC/Aberdeen 

On  Road 

Off  Road 

ALL 

GPR 

EMI  I 

IR 

ALL  j 

GPR 

EMI 

IR 

M 

1 

0.97 

0.97  j 

na 

HU 

1 

na 

Surface 

LM 

0.86 

0.86  ! 

o  T 

na 

H 

0.88 

0.13 

na 

NM 

0.83 

0.83  | 

0  i 

na 

na  j 

na 

na 

na 

M 

1 

0.53  ! 

1  i 

na 

1  \ 

0.79 

1 

na 

Subsurface 

LM 

0.56 

!  0.56  | 

"0.02"T* 

na 

0.8  | 

—9:17. _ 

niLj 

na 

NM 

0.67 

:  0.67  j 

■""o"T 

na 

na  j 

na 

na 

na 

On  Road 

Off  Road 

C  RC/oC 

>corro 

ALL 

GPR 

EMI  | 

IR 

ALL 

GPR  | 

EMI 

IR 

M 

1 

1 

i  1 

na 

1 

1  1 

1 

na 

Surface 

LM 

1 

"“o  T 

na 

1 

1  : 

0 

na 

NM 

na 

na 

na  i 

na 

na 

na  | 

na 

na 

M 

1 

0.81 

i  i 

na 

1 

0.19  j 

1 

na 

Subsurface 

LM 

0.8 

0.8 

-0— -T" 

na 

0.43 

0 

na 

NM 

0.93 

0.93 

— -0--t~ 

na 

na 

j  na  ; 

na 

na 

All  metal-cased  mines  were  found  by  CRC,  regardless  of  the  depth  of  the  mine 
and  the  test  location.  CRC’s  EMI  sensor  was  the  best  sensor  for  finding  the  metal  mines. 
At  both  sites,  surface  metal  mines  were  detected  by  its  GPR  with  a  higher  probability 
than  were  subsurface  metal  mines. 
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Surface,  low-metal  mines  were  detected  with  a  higher  probability  than  subsurface, 
low-metal  mines.  The  GPR  sensor  was  CRC’s  only  reliable  sensor  for  detecting  low- 
metal  mines. 

3.  Position  Resolution 
a.  On-Road  Tests 

Figure  V-4  shows  CRC’s  miss-distance  distributions  in  the  on-road  tests  at 
Aberdeen.  Along-track,  the  mean  (bias)  of  the  distribution  is  -1 8  cm.  This  bias  indicates 
that  the  CRC  system  systematically  measures  the  location  of  the  center  of  the  mine 
behind  its  actual  position  (and  outside  the  mine  radius).  This  bias  appears  in  measure¬ 
ments  of  both  the  surface  and  subsurface  mine  locations,  and  appears  to  be  primarily 
caused  by  a  systematic  offset  in  the  GPR’s  measurement  of  mine  location.  The  Standard 
Deviation  (RMS)  along-track  is  16  cm,  about  as  large  as  the  mean  radius  of  the  land 
mines  used  in  this  test.  Cross-track,  the  mean  is  14  cm  and  the  standard  deviation  is  27 
cm.  Both  of  these  distributions  have  very  nearly  the  expected  Gaussian  distribution, 
except  for  a  second  peak  around  50  cm  in  the  along-track  distribution. 


CRC:  On-Road,  Along  Track  Positions  CRC:  On-Road,  Across-Track  Positions 


Figure  V-4.  Miss-Distance  Distributions  of  the  Measured  Surface  and  Subsurface  Mine 
Locations  for  the  CRC  On-Road  Tests  at  Aberdeen.  Data  points  include  the  GPR 
and  EMI  sensors.  The  solid  curve  is  the  best  fit  of  a  constant  plus  a  Gaussian. 

CRC’s  metal  detector  causes  this  second  peak.  The  data  from  the  metal  detector 
exhibit  two  distinct  normal  distributions,  on  either  side  of  the  mean  (see  Figure  V-5). 
Although  the  cross-track  distribution  of  the  metal  detector  measurements  also  exhibits 
these  double-distributions,  it  does  not  show  up  in  the  overall  along-track  distributions  as 
an  artifact,  or  second  peak  (see  Figure  V-5).  Instead,  the  overall  distribution  is  widened 
significantly,  so  that  the  overall  cross-track  intrinsic  resolution  is  27  cm.  The  metal 
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detector’s  measurements  are  well  within  the  1-m  halo,  however,  although  the  RMS  of 
this  sensor  is  large. 


CRC:  Along  track,  subsurface,  EMI 


CRC:  Along  Track,  surface,  EMI 


Figure  V-5.  Miss-Distance  Distribution  for  CRC’s  EMI  Sensor, 
On-Road  at  Aberdeen.  Note  the  double  peaks. 


Table  V-9  summarizes  the  measured  biases  and  RMS  in  the  on-road  tests,  broken 
down  by  surface  and  subsurface  mines,  as  well  as  by  sensor.  Also  shown  are  the  mea¬ 
surements  from  the  on-road  tests  at  Socorro.  Note  that  for  subsurface  mines,  the  GPR 
measurement  is  significantly  offset  and  has  a  large  RMS.  Nevertheless,  there  is  no  signif¬ 
icant  overall  dependence  of  the  measurements  on  mine  location  (surface  or  subsurface). 
The  performances  in  the  on-road  tests  at  both  Aberdeen  and  Socorro  did  not  differ  from 
one  another. 


b.  Off-Road  Tests 

Figure  V-6  shows  CRC’s  miss-distance  distributions  in  the  off-road  tests  at  Aber¬ 
deen.  Along-track,  the  mean  (bias)  of  the  distribution  is  -14  cm.  This  bias  appears  to  be 
primarily  due  to  the  performance  of  the  metal  detector.  Again,  the  along-track  distribu¬ 
tion  exhibits  a  second  peak  around  40  cm,  due  to  the  metal  detector’s  measurements.  The 
offset  in  the  main  peak  (at  -14  cm)  is  due  in  this  case  to  an  offset  in  the  metal  detector’s 
measurement. 

The  cross-track  distribution  (as  shown  in  Figure  V-6)  is  also  biased  by  about 
17  cm.  This  bias  appears  to  be  due  to  a  bias  in  the  GPR  measurement  of  15  cm  sub¬ 
surface  and  21  cm  surface  (see  Table  V-10). 

Also  shown  in  the  table  are  the  measurements  from  the  off-road  tests  at  Socorro. 
These  results  do  not  differ  significantly  from  the  Aberdeen  measurements,  although  the 
statistics  are  poor. 
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Table  V-9.  CRC  Bias  and  Resolution  Performance  at  Aberdeen 
and  Socorro:  On-Road  Performance 


Aberdeen  Position  Resolution 

Socorro  Position  Resolution 

Type 

Along-track 

Cross-track 

Along-track 

Cros 

s-track 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

All  sensors, 
subsurface  +  surface 

-0.18 

0.16 

0.14 

0.27 

-0.16 

0.22 

0.11 

0.24 

All  sensors, 
subsurface 

-0.21 

0.14 

0.15 

0.32 

-0.24 

0.21 

0.10 

0.29 

GPR 

-0.42 

0.32 

0.23 

0.20 

-0.26 

0.29 

0.12 

0.15 

EMI 

-0.20 

0.11 

0.08 

0.38 

0.00 

Not  well 
fit 

0.08 

Not  well 
fit 

IR 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

All  sensors,  surface 

-0.15 

0.15 

0.13 

0.17 

-0.14 

0.20 

GPR 

-0.11 

0.13 

0.12 

0.13 

-0.13 

0.18 

0.09 

0.14 

EMI 

0.05 

See  Note 

0.05 

See  Note 

0.07 

Not  well 
fit 

0.14 

Not  well 
fit 

IR 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

Note:  These  distributions  of  the  On-Road  surface  metal  detector  measurements  were  non-Gaussian  and  thus  not  well  fit. 
The  mean  can  be  computed,  but  a  meaningful  standard  deviation  cannot. 


CRC:  Off-Road,  Along-Track  Positions  CRC;  off-Road,  Across-Track  Positions 


Figure  V-6.  Results  of  the  Measured  Surface  and  Subsurface  Mine  Locations 
for  the  CRC  Off-Road  Tests  at  Aberdeen.  Data  from  the  GPR  and  EMI  sensors 

are  included  in  these  plots. 
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Table  V-10.  CRC  Bias  and  Resolution  Performance  at  Aberdeen  and  Socorro: 

Off-Road  Performance 


Aberdeen  Position  Resolution 

Socorro  Position  Resolution 

Type 

Along-track 

Cross-track 

Along-track 

Cross-track 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

■ 

Standard 

Deviation 

(RMS) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

All  sensors, 
subsurface  +  surface 

-0.14 

0.27 

0.17 

0.34 

-0.21 

0.17 

0.12 

0.24 

All  sensors, 
subsurface 

-0.21 

0.20 

0.11 

0.35 

-0.22 

0.12 

0.06 

0.56 

GPR 

-0.04 

0.30 

0.15 

0.30 

Not 
well  fit 

Not  well 
fit 

Not 
well  fit 

Not  well 
fit 

EMI 

-0.27 

0.13 

0.08 

0.46 

-0.23 

0.12 

0.07 

0.74 

IR 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

All  sensors,  surface 

-0.14 

0.28 

0.21 

0.30 

-0.18 

0.20 

0.13 

0.15 

GPR 

-0.05 

0.10 

0.21 

0.18 

-0.15 

0.20 

0.12 

0.11 

EMI 

0.00 

See  Note 

0.11 

0.53 

Not 
well  fit 

Not  well 
fit 

Not 
well  fit 

Not  well 
fit 

IR 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

Note:  These  distributions  of  the  On-Road  surface  metal  detector  measurements  were  non-Gaussian  and  thus  not  well  fit. 
The  mean  can  be  computed,  but  a  meaningful  standard  deviation  cannot. 


4.  Pd  and  Rhal0 

The  bias  and  RMS  resolution  performance  of  the  sensors  affect  how  well,  as  a 
function  of  i?hal0,  CRC’s  system  detects  the  mines.  Figure  V-7  shows  a  plot  of  Pd  versus 
Rhi]o  for  the  tests  at  Aberdeen  and  Socorro.  These  figures  summarize  the  overall  implica¬ 
tion  of  CRC’s  bias  and  intrinsic  sensor  resolution  (as  tabulated  in  section  2). 

As  shown  in  the  plots,  the  detection  probability  for  CRC’s  sensors  was 
maximized  for  a  i?hal0  of  approximately  60  cm.  If  this  ATD  had  required  i?hal0  to  be  sig¬ 
nificantly  smaller  (for  instance,  25  cm),  then  CRC’s  Pd  performance  would  have  been 
significantly  degraded,  except  for  the  on-road  performance  at  Socorro.  This  is  because 
the  combination  of  CRC’s  sensor  bias  systematically  misplaces  the  center  of  the  mine, 
and  intrinsic  RMS  resolution  widens  the  probable  area  of  mine  location. 
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CRC 


-  Subsurface 

-  Surface 


Figure  V- 7.  Pd  vs.  /?halo  for  CRC’s  Sensor  Suite  at  Aberdeen  and  Socorro 


5.  Additional  Runs 

a.  Aberdeen  Results 

Additional  runs  by  CRC  at  Aberdeen  include  two  night  runs  on  lane  15  and  one 
physical-marking  run  on  lane  1 1 .3  Table  V-l  1  shows  the  cumulative  Pj5  and  FARs  for  the 
scored  on-road  day  runs  and  the  night  runs  on  lane  15.  Notice  that  CRC  did  not  use  its  IR 
during  either  the  day  or  night  runs.  The  Pjs  for  surface  and  subsurface  mines  are  actually 
higher  for  the  night  runs,  and  the  FAR  at  night  is  lower  than  the  FAR  for  the  day  runs. 
Recall  that  the  night  runs  were  only  conducted  on  two  passes  of  one  lane  (lane  15),  so  the 
error  bars  are  rather  large.  Examination  of  Tables  B-3  through  B-5  in  Appendix  B  shows 
that  CRC  had  its  best  Pjs  on  lane  15  (both  over  90  percent),  whereas  on  lane  12  both  Pd s 


3  The  results  of  these  runs  are  summarized  in  Tables  B-6  and  B-8  in  Appendix  B  and  can  be  compared 
to  the  results  CRC  obtained  on  its  scored  daytime  runs  on  lanes  1 1  and  1 5  as  shown  in  Tables  B-3  and 
B-5. 
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were  approximately  70  percent,  and  on  lane  11  one  was  92  percent  and  the  other  84 
percent.  CRC  began  the  week  testing  on  lane  12,  then  moved  to  lane  11,  and  finally 
finished  its  on-road  tests  on  lane  15  on  June  16  (see  Table  11-13).  The  following  night, 
CRC  conducted  its  night  runs  on  lane  15  (see  Table  V-II-15).  It  is  possible  that  CRC’s 
above  average  performance  on  lane  15  at  night  is  related  to  its  gradual  performance 
improvement  over  the  course  of  the  week. 

Table  V-11.  Comparison  of  CRC  On-Road  Day  and  Night  Runs  at  Aberdeen 


On-Road  Day 

Night 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pa 

0.919 

0.773 

1.0 

0.900 

IR  Pa 

N/A 

N/A 

N/A 

N/A 

Total  FAR 

0.034  rrf2 

0.022  nT2 

IR  FAR 

N/A 

N/A 

Table  V-12  shows  the  cumulative  Pd s  and  FARs  for  the  scored  on-road  day  runs, 
and  the  Pd  and  FAR  obtained  for  one  pass  on  lane  1 1  using  CRC’s  physical  marking 
system  (where  alarm  positions  are  determined  by  surveying  the  marks  deposited  on  the 
ground).  The  Pd s  for  surface  and  subsurface  mines  are  nearly  the  same  for  both  sets  of 
runs,  while  the  FAR  for  the  physical-marking  run  is  one-half  of  the  FAR  for  the  on-road, 
day  runs.  This  surprising  result  indicates  a  difference  in  the  treatment  of  physical  declara¬ 
tions  that  actually  improves  the  system’s  FAR  performance  compared  to  electronic- 
marking  runs. 


Table  V-12.  Comparison  of  CRC  On-Road  Day  (Electronic-Marking) 
and  Physical-Marking  Runs  at  Aberdeen 


On-Road  Day  (EM) 

Physical  Marking  (PM) 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

0.773 

0.929 

0.783 

Total  FAR 

0.034  m"2 

0.017  rrf2 
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We  examine  the  position  resolution  of  the  physical-marking  runs  and  compare 
these  to  the  position  resolutions  for  the  electronic-marking,  on-road  day  runs.  Table  V-13 
summarizes  the  results.  We  notice  that  the  position  resolution  (RMS)  is  much  poorer  for 
the  physical-marking  system.  The  RMS  in  both  the  along-track  and  cross-track  directions 
for  the  physical-marking  system  as  used  on  lane  1 1  is  greater  than  for  the  on-road,  day 
RMS  from  electronic  marking.  In  addition,  the  mean  for  the  on-road  day  runs  was 
-0.18  m,  while  for  the  physical-marking  run,  it  was  +0.15  m.  Recall  that  the  errors  for  the 
physical-marking  run  are  large  due  to  the  small  number  of  mines  encountered. 


Table  V-13.  Comparison  of  CRC  Position  Resolution  for  On-Road  Day 
(Electronic-Marking)  and  Physical-Marking  Runs  at  Aberdeen 


On-Road  Day  (EM) 

Physical  Marking  (PM) 

Mean  (m) 

RMS  (m) 

Mean  (m) 

RMS  (m) 

Along  Track 

-0.18 

0.16 

0.15 

0.47 

Cross  Track 

0.14 

0.27 

0.06 

0.41 

b.  Socorro  Results 

Additional  runs  by  CRC  at  Socorro  include  two  night  runs  on  lane  4,  one  night 
run  on  lane  6,  two  physical-marking  runs  on  lane  8,  two  morning  runs  on  lane  4,  and  one 
morning  run  on  lane  6.4  The  cumulative  Pjs  and  FARs  for  the  on-road  day  runs,  and  the 
night  runs  on  lane  4  and  6  are  shown  in  Table  V-14.  The  Pd  for  subsurface  mines  is 
slightly  higher  at  night  than  for  day,  and  that  the  FAR  is  slightly  lower  for  the  night  runs. 
Again,  CRC  did  not  use  its  IR  for  either  the  day  or  night  runs. 


4  The  results  of  these  runs  are  summarized  in  Table  B-18  through  B-20  in  Appendix  B  and  can  be 
compared  to  the  results  CRC  obtained  on  its  scored  daytime  runs  on  lanes  4,  6,  and  8  as  shown  in 
Tables  B-10  through  B-12,  respectively. 
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Table  V-14.  Comparison  of  CRC  On-Road  Day  and  Night  Runs  at  Socorro 


On-Road  Day 

Night 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.905 

1.0 

0.963 

IR  Pa 

N/A 

N/A 

N/A 

N/A 

Total  FAR 

0.037  m'2 

0.025  m'2 

IR  FAR 

N/A 

N/A 

For  the  two  physical-marking  runs  conducted  by  CRC  on  lane  8  at  Socorro,  both 
electronic  and  physical-marking  files  were  produced.  That  is,  for  a  given  pass  of  a  lane, 
the  contractor  produced  the  usual  electronic  alarm  file  as  well  as  physically  marked  the 
ground  with  alarms,  the  positions  of  which  could  subsequently  be  surveyed.  Correlating 
in  the  results  of  these  two  types  of  alarm  files  gives  some  indication  of  how  the 
contractor’s  physical  marking  system  works.  One  might  expect  there  to  be  a  one-to-one 
correspondence  between  the  number  of  alarms  in  corresponding  EM  and  PM  files.  There 
are  circumstances,  however,  that  might  negate  this  one-to-one  correspondence,  such  as  a 
clogged  dispenser.  In  addition,  for  a  given  down-track  position,  the  number  of  cross-track 
physical  marking  alarms  may  be  limited  by  the  finite  number  of  dispensers  on  the 
contractor’s  vehicle.  Position  resolution  issues  may  also  become  important  when 
comparing  the  electronic  alarms  with  the  physical  alarms. 

Table  15  shows  cumulative  and  FARs  for  CRC’s  on-road  day  runs  and  the 
physical-marking  runs  on  lane  8  at  Socorro.  The  Pd  is  1.0  for  surface  mines  for  both  the 
on-road  day  runs  and  the  physical-marking  runs.  For  subsurface  mines,  the  Pd  is  slightly 
higher  for  the  physical-marking  runs,  although  the  error  bars  are  large.  The  FAR  for 
physical-marking  runs  is  two-thirds  that  of  electronic-marking  runs. 

In  Table  16,  the  position  resolution  for  the  physical-marking  runs  is  compared  to 
the  position  resolution  of  the  on-road  day  runs.  We  notice  that  the  location  accuracy  in 
the  along-track  direction  as  measured  by  the  standard  deviation  is  greater  for  the 
physical-marking  runs,  but  the  cross-track  location  accuracy  is  nearly  the  same  for  both 
sets  of  tests.  The  means  are  similar  in  both  the  along-track  and  cross-track  directions. 
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Table  V-15.  Comparison  of  CRC  On-Road  Day  and  Physical-Marking  Runs  at  Socorro 


On-Road  Day 

Physical  Marking  (PM) 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.905 

1.0 

1.0 

Total  FAR 

0.037  nrf2 

0.023  nrf2 

Table  V-16.  Comparison  of  CRC  Position  Resolution  for  On-Road  Day  and  Physical- 

Marking  Runs  at  Socorro 


On-Road  Day 

Physical  Marking  (PM) 

Mean  (m) 

Std  (m) 

Mean  (m) 

Std  (m) 

Along  Track 

-0.16 

0.22 

-0.09 

0.35 

Cross  Track 

0.11 

0.24 

0.15 

0.23 

Note  the  differences  between  the  two  methods  of  producing  alarms  (electronic 
and  physical)  for  the  two  runs  on  lane  8.  Table  17  shows  Pjs,  FARs,  and  number  of 
alarms  for  CRC’s  two  physical-marking  runs  on  lane  8  at  Socorro.  For  the  first  pass  of 
lane  8  (EM-1  and  PM-1),  the  Pjs  and  FARs  are  identical,  but  the  number  of  physical 
marks  (PM)  is  slightly  less  than  the  number  of  electronic  marks  (EM).  For  the  second 
pass  of  lane  8,  the  PM  and  EM  Pjs  are  both  1 .0,  but  the  PM  FAR  is  about  half  the  rate  for 
the  corresponding  electronic  marking  (EM)  system.  Note  that  the  number  of  physical 
marks  is  much  less  than  the  number  of  electronic  marks  (79  compared  to  176).  This  result 
again  indicates  a  difference  in  the  treatment  of  physical  declarations  that  actually  im¬ 
proves  the  system’s  FAR  performance  compared  to  electronic-marking  runs. 

Table  V-17.  Comparison  of  CRC  Lane  8  Physical-Marking  Runs  (EM  and  PM)  at  Socorro 


EM-1 

PM-1 

EM-2 

PM-2 

1.0 

1.0 

1.0 

1.0 

FAR  (m“2) 

0.018 

0.018 

0.056 

0.028 

#  Alarms 

85 

77 

176 

79 
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CRC  was  one  of  two  contractors  that  conducted  morning  runs  at  Socorro.  These 
runs  consisted  of  two  passes  of  lane  4  followed  by  one  pass  of  lane  6.  The  intention  was 
to  conduct  the  tests  around  sunrise.  In  reality,  the  tests  were  not  begun  until  8:47  A.M. 
and  did  not  conclude  until  9:41  A.M.,  and  CRC  began  one  of  its  day  tests  at  10:43  A.M. 
Thus,  the  differences  in  the  conditions  of  the  morning  tests  and  the  day  tests  were  not  as 
significant  as  intended.  The  Table  V-18  shows  the  Pjs  and  FARs  for  the  on-road  day  runs 
and  the  morning  runs  on  lane  4  and  lane  6.  For  each  set  of  tests,  all  the  surface  mines 
were  detected.  The  Pd  for  the  subsurface  mines  was  slightly  higher  for  the  morning  runs, 
and  the  FARs  for  the  two  test  conditions  were  nearly  the  same. 

Table  V-18.  Comparison  of  CRC  On-Road  Day  and  Morning  Runs  at  Socorro 


On-Road  Day 

Morning 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

1.0 

0.963 

Total  FAR 

0.037  irf2 

0.035  m~2 

C.  EG&G  PERFORMANCE 

1.  Individual  Sensor  and  Sensor  Pair  Performance 

As  illustrated  in  Table  V-19,  EG&G’s  GPR  was  its  most  effective  single  sensor:  it 
had  the  highest  Pd  for  all  conditions  at  both  Aberdeen  and  Socorro.  It  was  especially 
effective  in  surface  detections,  as  the  other  sensors  contributed  insignificantly  to  the  total 
detection  probability.  The  EMI  and  IR  detectors,  however,  did  contribute  to  the  subsur¬ 
face  mine  detection  probability,  especially  at  Aberdeen. 

The  false-alarm  rate  for  the  EG&G  system  was  usually  dominated  by  its  GPR 
sensor.  The  only  condition  where  this  was  not  the  case  was  in  the  on-road  condition  at 
Aberdeen,  where  its  IR  sensor  registered  a  false-alarm  rate  that  was  30  percent  higher 
than  the  GPR.  The  EMI  sensor  registered  a  very  low  false-alarm  rate. 

No  single  pair  of  sensors  was  responsible  for  the  detection  performance  of  the 
entire  system.  Although  the  GPR  was  the  workhorse,  at  times  the  EMI  sensor  and  the  IR 
sensor  contributed  in  important  ways  to  the  overall  detection  performance. 
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Table  V-19.  EG&G’s  False-Alarm  Rates  and  Detection  Probabilities  Listed  for  Individual 
Sensors,  Sensor  Pairs,  and  the  Total  System.  Results  from  the  Aberdeen  and 
Socorro  sites  are  listed  separately.  False-alarm  rates  are  quoted  in  the 
units  m~2,  and  detection  probabilities  are  given  in  percent.  G,  M,  and  I 
refer  to  GPR,  EMI,  and  IR,  respectively. 


EG&G 


Aberdeen 

G 

M 

1 

GM 

Ml 

Gl 

TOTAL 

on-road  FAR 

0.036 

0 

0.047 

0.036 

0.047 

0.081 

0.081 

on-road,  subsurface  Pd 

69.7 

47 

62.1 

72.7 

85.6 

92.4 

93.2 

on-road,  surface  Pd 

97.7 

41.9 

77.9 

97.7 

88.4 

100 

100 

off  road  FAR 

0.078 

0.004 

0.02 

0.081 

0.023 

0.095 

0.099 

off-road,  subsurface  Pd 

79.4 

55.9 

45.6 

89.7 

77.9 

86.8 

95.6 

off-road,  surface  Pd 

93.8 

50 

89.6 

93.8 

91.7 

95.8 

95.8 

Socorro 

G 

M 

1 

GM 

Ml 

Gl 

TOTAL 

on-road  FAR 

0.036 

0.001 

0.007 

0.037 

0.008 

0.042 

0.043 

on-road,  subsurface  Pd 

90.5 

46.6 

24.3 

90.5 

60.1 

91.9 

91.9 

on-road,  surface  Pd 

96.9 

47.9 

80.2 

96.9 

86.5 

96.9 

96.9 

off  road  FAR 

0.041 

0 

0.019 

0.041 

0.019 

0.058 

0.058 

off-road,  subsurface  Pd 

60 

53.3 

10 

70 

53.3 

63.3 

70 

off-road,  surface  Pd 

100 

66.7 

88.9 

100 

100 

100 

100 

2.  Detection  Probability  Versus  Metal  Content  of  Mine 

Table  V-20  summarizes  EG&G’s  detection  probability  versus  metal  content,  for 
on-  and  off-road,  surface  and  subsurface  conditions.  The  detection  probability  is  given  for 
all  sensors,  as  well  as  for  individual  sensor  types. 

At  both  sites,  metal-cased  mines  were  detected  by  EG&G  with  a  very  high 
probability,  regardless  of  the  depth.  EG&G’s  EMI  sensor  was,  on  average,  the  best  sensor 
for  finding  the  metal  mines.  The  GPR  performed  well  at  detecting  metal  mines,  except 
for  off-road,  subsurface  mines.  The  IR  sensor  showed  a  degradation  of  performance  for 
subsurface  metal  mines  compared  to  surface  metal  mines. 

Low-metal  mines  were  detected  with  a  higher  probability  when  they  were  on  the 
surface.  Neither  the  GPR  nor  the  IR  sensors  stood  out  as  the  dominant  sensor  for 
selecting  low-metal  mines,  but  rather  a  combination  of  the  sensors  achieved  their  perfor¬ 
mance  with  this  mine  type. 
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Table  V-20.  EG&G’s  Detection  Probability  vs.  Metal  Content  at  Aberdeen  and  Socorro 


EG&G/Aberdeen 

On  Road 

Off  Road 

ALL  GPR  EMI  |  IR 

ALL  GPR 

EMI 

IR 

Surface 

M 

1  1  1  i  0.75 

1 

1 

1 

0.96 

LM 

1  I  0.98  I  0  T  0.77 

0.92 

0.88 

0 

0.83 

NM 

o 

CO 

CO 

o 

na 

na 

na 

na 

Subsurface 

M 

1  i  0.94  j  1  i  0.5 

1 

0.82 

1  1 

0.42 

LM 

0.86  |  0.48  j  0  j  0.7 

0.9 

0-77 

1 — p. — | 

|— M_ 

NM 

i  i  o.5  !  6  :1 

na 

na 

na 

I  na 

EG&G/Socorro 

On  Road 

Off  Road 

ALL 

GPR 

EMI 

J_ 

IR 

ALL 

GPR 

EMI 

IR 

M 

0.96 

0.96 

0.96 

1 

1 

1 

0.83 

1 

1 

1 

0.83 

Surface 

LM 

0.98 

0.98 

o 

i 

1 

0.77 

i 

1 

0 

i 

NM 

na 

na 

na 

1 

I 

1 

na 

na 

na 

na 

na 

M 

1 

1 

0.97 

1 

1 

0.23 

1 

0.81 

1 

0.19 

Subsurface 

LM 

0.83 

0.8 

0.02 

1 

1 

_ L_. 

0.23 

0.36 

0.36 

h _ 9- _ 

. ?. . 

NM 

0.93 

0.93 

o 

- j... 

1 

1 

0.36 

na 

na 

na 

na 

3.  Position  Resolution 

a.  On-Road  Tests 

Figure  V-8  shows  EG&G’s  miss-distance  distributions  in  the  on-road  tests  at 
Aberdeen.  Along-track,  the  mean  (bias)  of  the  distribution  is  9  cm. 

As  shown  in  Table  V-21,  this  skew  in  the  along-track  distribution  appears  to  be 
caused  by  the  measurements  of  the  locations  of  the  surface  mines  in  the  along-track 
direction.  The  along-track  distribution  shows  that  these  measurements  were  slightly 
biased  (in  the  positive  direction),  which  in  turn  shows  up  as  a  slight  skew  in  the  overall 
(surface  and  subsurface)  distribution.  These  measurements  are  summarized  in  Table 
V-21.  Measurements  from  the  on-road  tests  at  Socorro  are  also  listed;  they  are  similar  to 
the  Aberdeen  results. 

From  Table  V-21  it  appears  that  all  three  sensors  were  likewise  offset,  so  the 
cause  of  the  bias  is  not  clear.  The  RMS  along  track  is  24  cm,  which  is  slightly  larger  than 
the  mean  radius  of  the  land  mines  used  in  this  test.  Cross-track,  the  mean  is  7  cm  (nearly 
unbiased)  and  the  standard  deviation  is  1 1  cm,  less  than  the  mean  radius  of  land  mines 
used  in  this  test.  As  can  be  seen  by  the  data,  the  performance  of  individual  sensors  does 
not  differ  significantly  from  the  overall  performance. 
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EG&G:  On-Road,  Atong-Track  Positions 


EG&G:  On-Road,  Across-Track  Positions 


Figure  V-8.  Results  of  the  Measured  Surface  and  Subsurface  Mine  Locations 
for  the  EG&G  On-Road  Tests  at  Aberdeen.  Data  from  the  GPR,  EMI, 
and  Optical  sensors  are  included  in  these  plots. 


Table  V-21.  EG&G  Bias  and  Resolution  Performance  at  Aberdeen  and  Socorro: 

On-Road  Performance 


Aberdeen  Position  Resolution 

Socorro  Position  Resolution 

Type 

Along-track 

Cross-track 

Along-track 

Cross-track 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

All  sensors, 
subsurface  +  surface 

0.09 

0.24 

0.07 

0.11 

0.14 

0.20 

0.09 

0.13 

All  sensors, 
subsurface 

0.07 

0.20 

0.10 

0.11 

0.18 

0.19 

0.09 

0.12 

GPR 

0.06 

0.21 

0.09 

0.11 

0.16 

0.20 

0.10 

0.13 

EMI 

0.08 

0.16 

0.11 

0.10 

0.24 

0.14 

0.08 

0.09 

IR 

-0.01 

0.15 

0.06 

0.09 

0.06 

0.11 

0.07 

0.10 

All  sensors,  surface 

i  0.12 

0.26 

0.05 

0.11 

0.08 

0.18 

0.06 

0.11 

GPR 

0.14 

0.25 

0.05 

0.10 

0.07 

0.17 

1  0.05 

0.10 

EMI 

0.16 

0.17 

0.06 

0.09 

0.11 

0.14 

0.07 

0.09 

IR 

0.25 

0.13 

0.04 

0.10 

0.07 

0.10 

0.07 

0.08 
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b.  Off  Road 


Figure  V-9  shows  EG&G’s  miss-distance  distribution  in  the  off-road  tests  at 
Aberdeen.  Along  track,  the  mean  (bias)  of  the  distribution  is  9  cm,  while  the  RMS  along- 
track  is  20  cm,  consistent  with  the  on-road  test.  The  cross-track  measurements  again 
appear  to  probably  have  no  bias,  but  at  30  com,  the  RMS  is  inconsistent  with  the  on-road 
tests.  This  larger  intrinsic  resolution  is  likely  caused  by  a  larger  resolution  than  pre¬ 
viously  found  in  the  GPR  and  EMI  sensors.  Table  V-22  details  the  results  from  these 
distributions  for  both  the  Aberdeen  and  Socorro  off-road  tests. 

EG&G:  Off-Road,  Along-Track  Positions  EG&G:  Off-Road,  Across.-Track  Positions 


Figure  V-9.  Results  of  the  Measured  Surface  and  Subsurface  Mine  Locations 
for  the  EG&G  Off-Road  Tests  at  Aberdeen.  Data  from  the  GPR,  EMI,  and 
optical  sensors  are  included  in  these  plots. 


4.  P.mdR^, 

The  bias  and  RMS  resolution  performance  of  the  sensors  affect  how  well,  as  a 
function  of  i?halo,  EG&G’s  system  detects  the  mines.  Figure  V-10  shows  a  plot  of  Pd 
versus  i?halo  for  the  tests  at  Aberdeen  and  Socorro.  These  figures  summarize  the  overall 
implication  of  EG&G’s  relatively  small  bias  and  intrinsic  sensor  resolution  (as  tabulated 
in  section  2). 

As  shown  in  the  plots,  the  detection  probability  for  EG&G’s  sensors  reached  a 
maximum  when  i?balo  was  approximately  30  cm.  If  this  ATD  had  required  i?halo  to  be  as 
small  as  25  cm,  then  EG&G’s  Pd  performance  would  have  been  approximately 
unchanged. 


V-23 


Table  V- 22.  EG&G  Bias  and  Resolution  Performance  at  Aberdeen  and  Socorro: 

Off-Road  Performance 


Aberdeen  Position  Resolution 

Socorro  Position  Resolution 

Type 

Along-track 

Cross-track 

Along-track 

Cross-track 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

All  sensors, 
subsurface  +  surface 

0.09 

0.20 

0.08 

0.30 

0.15 

0.17 

0.07 

0.11 

All  sensors, 
subsurface 

0.09 

0.16 

0.07 

0.27 

0.23 

0.15 

GPR 

0.22 

0.01 

0.29 

0.21 

0.15 

0.11 

EMI 

0.10 

0.12 

0.07 

Poor 

stats 

Poor 

stats 

Poor 

stats 

Poor 

stats 

IR 

0.09 

0.12 

0.23a 

0.33 

Poor 

stats 

Poor 

stats 

Poor 

stats 

Poor 

stats 

All  sensors,  surface 

0.08b 

0.23 

0.1 5b 

0.20 

0.06 

0.20 

0.07 

0.11 

GPR 

0.1 4b 

0.20 

0.00b 

0.02 

0.05 

0.18 

0.07 

0.13 

EMI 

0.06b 

0.17 

0.1 3b 

0.15 

0.13 

0.15 

Poor 

stats 

Poor 

stats 

IR 

0.05b 

0.12 

0.1 4b 

0.21 

Poor 

stats 

Poor 

stats 

0.08 

0.09 

*  This  distribution  is  not  normally  distributed.  Although  the  bias  appears  to  be  real,  it  is  probably  not  as  severe  as  23  cm. 


"  These  distributions  had  poor  statistics;  thus,  the  error  on  the  mean  is  quite  large.  This  means  that  it  cannot  be 
determined  if  the  offsets  in  surface  mine  locations  is  due  to  a  real  bias  in  the  sensors. 


5.  Additional  Runs 

a.  Aberdeen  Results 

Additional  runs  by  EG&G  at  Aberdeen  include  one  night  run  on  lane  12,  one 
night  run  on  lane  1 1 ,  and  one  physical-marking  run  (resulting  in  two  alarm  files — one 
electronic-marking  file  and  one  physical-marking  file)  on  lane  15.5  Table  23  shows  the 
cumulative  P js  and  FARs  for  the  on-road  day  runs,  and  the  night  runs  on  lane  1 1  and  lane 
12.  The  total  Pd  is  lower  on  the  night  run  for  subsurface  mines.  Notice  also  that  the  IR  Pd 
drops  significantly  for  both  surface  and  subsurface  mines  at  night.  For  subsurface  mines 
at  night,  the  IR  Pd  is  nearly  zero.  The  FARs  for  both  sets  of  tests  were  very  high,  with 


5  The  results  of  these  runs  are  summarized  in  Tables  B-6  through  B-8  in  Appendix  B  and  can  be 
compared  to  the  results  EG&G  obtained  on  the  on-road  day  runs  on  lanes  11,  12,  and  15  as  shown  in 
Tables  B-3  through  B-5. 
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about  half  the  false  alarms  attributed  to  the  IR  for  the  on-road  day  runs,  and  only  about  10 
percent  of  the  false  alarms  due  to  the  IR  for  the  night  runs. 

EG&G 


Subsurface 

Surface 


Figure  V-10.  Pd  vs.  Rh,l0  for  EG&G’s  Sensor  Suite  at  Aberdeen  and  Socorro 
Table  V-23.  Comparison  of  EG&G  On-Road  Day  and  Night  Runs  at  Aberdeen 


On-Road  Day 

Night 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.932 

1.0 

0.739 

0.779 

0.621 

0.393 

0.022 

Total  FAR 

0.081  m~2 

0.143  nr2 

IR  FAR 

0.047  irf2 

0.014nr2 
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For  the  physical-marking  run  conducted  by  EG&G  on  lane  15  at  Aberdeen,  both 
electronic-  and  physical-marking  files  were  produced.6  Table  V-24  compares  the  per¬ 
formance  measures  of  the  on-road  day  runs  with  the  physical-marking  run  on  lane  15.  For 
both  surface  and  subsurface  mines,  the  Pjs  for  the  physical-marking  run  are  significantly 
lower  than  the  Pd s  for  the  day  runs.  Table  V-B-8  in  Appendix  B  shows  that  EG&G 
missed  surface  metal  mines  for  the  PM  run.  The  FAR  for  the  physical-marking  run  is 
much  lower  than  comparable  day  runs  with  electronic  marking. 


Table  V-24.  Comparison  of  EG&G  On-Road  Day 
and  Physical-Marking  Runs  at  Aberdeen 


On-Road  Day  (EM) 

Physical  Marking  (PM) 

Surface 

Subsurface 

Surface 

Subsurface 

Total  P„ 

1.0 

0.932 

0.667 

0.700 

Total  FAR 

0.081  irf2 

0.027  m'2 

Table  V-25  shows  the  position  resolution  for  the  on-road  day  runs  and  the 
physical-marking  run.  Note  that  the  RMS  values  in  the  along-track  and  cross-track  direc¬ 
tions  are  smaller  for  the  physical-marking  run,  but  not  significantly.  The  along-  and 
cross-track  biases  are  similar  in  physical-marking  and  electronic-marking  runs. 


Table  V-25.  Comparison  of  EG&G  Position  Resolution  for  On-Road  Day 
and  Physical-Marking  Runs  at  Aberdeen 


On-Road  Day 

Physical  Marking  (PM) 

Mean  (m) 

RMS  (m) 

Mean  (m) 

RMS  (m) 

Along  Track 

0.09 

0.24 

0.08 

0.18 

Cross  Track 

0.07 

0.11 

0.0 

0.08 

Table  V-26  compares  the  Pjs  and  FARs  for  the  EM  and  PM  systems  for  the 
physical-marking  run  on  lane  15.  Two  of  the  undetected  mines  for  the  PM  system  were 
surface,  metal  mines  (see  Table  B-8  in  Appendix  B).  Since  these  mines  were  detected  by 
the  EM  system,  the  probable  cause  of  the  poor  PM  Pd  is  a  malfunction  of  the  physical- 


6  The  results  of  these  runs  are  shown  in  Table  B-8. 
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marking  system.  Note  also  in  Table  V-26  that  the  number  of  alarms  for  the  PM  system  is 
about  30  percent  less  than  the  number  of  alarms  for  the  EM  system. 


Table  V-26.  Comparison  of  EG&G  Lane  15  Electronic-Marking 
and  Physical-Marking  Runs  (EM  and  PM)  at  Aberdeen 


EM-1 

PM-1 

p. 

0.857 

0.686 

FAR  (m~2) 

0.042 

0.028 

#  Alarms 

91 

61 

b.  Socorro  Results 

Additional  runs  by  EG&G  at  Socorro  include  one  night  run  on  lane  6,  two  night 
runs  on  lane  4,  three  tele-operated  runs  on  lane  6,  and  three  physical-marking  runs 
(resulting  in  six  alarm  files — three  electronic  and  three  physical)  on  lane  4. 7  The 
cumulative  P £  and  FARs  for  the  on-road  day  runs,  and  the  night  runs  on  lanes  4  and  6  are 
shown  in  Table  V-27.  For  surface  mines,  we  note  that  the  total  are  nearly  the  same  for 
day  and  night  runs,  and  that  the  IR  performed  better  at  night.  For  subsurface  mines,  the 
IR  was  used  sparingly  both  during  the  day  and  during  the  night.  The  total  FAR  for  the 
night  runs  was  lower  than  for  the  day  runs,  with  the  IR  contributing  a  negligible  number 
of  false  alarms  under  both  test  conditions. 

Table  V-27.  Comparison  of  EG&G  On-Road  Day  and  Night  Runs  at  Socorro 


On-Road  Day 

Night 

Surface 

Subsurface 

Surface 

Subsurface 

0.969 

0.919 

1.0 

0.889 

mm 

0.802 

0.243 

1.0 

0.185 

Total  FAR 

0.043  m~2 

0.028  m"2 

IR  FAR 

0.007  m'2 

0.009  m'2 

7  The  results  of  these  runs  are  summarized  in  Tables  B-17  through  B-19  in  Appendix  B  and  can  be 
compared  to  the  results  EG&G  obtained  on  its  scored  daytime  runs  on  lanes  4  and  6  shown  in  Tables 
B-10  and  B-l  1,  respectively. 
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Table  V-28  shows  the  cumulative  Pjs  and  FARs  for  the  on-road  day  runs  and  the 
tele-operated  runs  conducted  on  lane  6.  The  Pd  for  both  surface  and  subsurface  mines  is 
slightly  higher  for  the  tele-operated  runs,  and  the  FAR  for  the  tele-operated  runs  is 
approximately  50  percent  greater  than  the  FAR  for  the  day  runs.  Recall  that  the  error  bars 
for  the  tele-operated  runs  are  large  due  to  the  limited  number  of  mine  encounters.  Still,  it 
is  clear  that  the  tele-operated  system  performed  capably. 

Table  V-28.  Comparison  of  EG&G  On-Road  Day  and  Tele-operated  Runs  at  Socorro 


On-Road  Day 

Tele-operated 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

0.969 

0.919 

1.0 

0.963 

Total  FAR 

0.043  rrf2 

0.063  rrf2 

For  the  three  physical-marking  runs  conducted  by  EG&G  on  lane  4  at  Socorro, 
both  electronic  and  physical  marking  files  were  produced.  The  results  of  these  runs  are 
shown  in  Table  V-B-17.  Table  V-29  compares  the  performance  measures  of  the  on-road 
day  runs  and  the  physical-marking  runs  on  lane  4.  For  the  physical-marking  runs,  all 
surface  and  subsurface  mines  were  detected,  but  the  PM  FAR  was  three  times  the  FAR  for 
the  day  runs. 

Table  V-29.  Comparison  of  EG&G  On-Road  Day  and  Physical-Marking  Runs  at  Socorro 


On-Road  Day 

Physical  Marking  (PM) 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pa 

0.969 

0.919 

1.0 

1.0 

Total  FAR 

0.043  m'2 

0.122  m"2 

In  Table  V-30,  the  position  resolution  of  the  physical-marking  system  is 
compared  to  the  position  resolution  of  the  electronic  marking  system.  The  location 
accuracy  of  the  PM  system,  as  given  by  the  standard  deviation  of  along-track  and  cross- 
track  offsets,  is  about  50  percent  greater  than  the  EM  system  in  the  along-track  direction 
and  slightly  less  than  the  EM  system  in  the  cross-track  direction.  For  both  along-  and 
cross-track  directions,  the  mean  is  9  cm  less  for  the  PM  system  than  for  the  EM  system. 
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Table  V-30.  Comparison  of  EG&G  Position  Resolution  for  On-Road  Day 
and  Physical-Marking  Runs  at  Socorro 


On-Road  Day 

Physical  Marking  (PM) 

Mean  (m) 

RMS  (m) 

Mean  (m) 

RMS  (m) 

Along  Track 

0.14 

0.20 

0.04 

0.31 

Cross  Track 

0.09 

0.13 

0.0 

0.09 

Table  V-31  summarizes  the  results  of  the  physical-marking  system  with  the 
electronic-marking  system  for  the  three  passes  of  lane  4.  We  first  note  that  the  Pd s  are  all 
1.0  for  both  systems  on  all  three  passes.  For  the  first  two  passes,  the  number  of  alarms  is 
less  for  the  PM  system  than  the  EM  system,  resulting  in  lower  FARs  for  the  PM  system. 
For  the  third  pass,  the  number  of  alarms  and  FARs  is  the  same  for  the  EM  and  PM 
systems. 


Table  V-31.  Comparison  of  EG&G  Lane  4  Physical-Marking  Runs  (EM  and  PM)  at  Socorro 


EM-1 

PM-1 

EM-2 

PM-2 

EM-3 

PM-3 

P, , 

1.0 

1.0 

1.0 

1.0 

1.0 

1.0 

FAR  (rrf2) 

0.092 

0.084 

0.106 

0.094 

0.186 

0.186 

#  Alarms 

85 

79 

91 

80 

131 

131 

D.  GDE  PERFORMANCE 

1.  Individual  Sensor  and  Sensor  Pair  Performance 

As  shown  in  Table  V-32,  GDE’s  GPR  sensor  was  the  greatest  contributor  to 
detections.  At  Socorro,  there  was  no  real  marginal  benefit  from  either  the  EMI  sensor  or 
the  IR  sensor.  At  Aberdeen,  however,  both  the  metal  and  IR  sensors  contributed  to  the 
system’s  total  detections. 

The  GPR  sensor  also  contributed  bulk  of  the  false  alarms.  In  fact,  the  only  case 
where  there  was  any  significant  contribution  to  the  false  alarms  from  the  EMI  and  IR 
sensors  was  in  the  off-road  lane  at  Aberdeen,  where  the  GPR  still  contributed  about  70 
percent  of  the  total  false  alarms. 
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The  GPR-EMI  sensor  pair  matched  the  total  system  performance  in  all  conditions 
except  for  the  off-road  lane  at  Aberdeen.  There,  the  three  sensors  were  each  important 
contributors  to  the  total  detections.  In  the  on-  and  off-road  lanes  at  Aberdeen,  the  EMI 
sensor  contributed  significantly  to  the  total  detection  probability. 

Table  V-32.  GDE’s  False-Alarm  Rates  and  Detection  Probabilities  Listed  for  Individual 
Sensors,  Sensor  Pairs,  and  the  Total  System.  Results  from  the  Aberdeen  and 
Socorro  sites  are  listed  separately.  False-alarm  rates  are  quoted  in  the 
units  m~2,  and  detection  probabilities  are  given  in  percent.  G,  M,  and  I 
refer  to  GPR,  EMI,  and  IR,  respectively. 


GDE 


Aberdeen 

G 

M 

1 

GM 

Ml 

Gl 

TOTAL 

on-road  FAR 

0.067 

0.002 

0 

0.068 

0.002 

0.067 

0.068 

on-road,  subsurface  Pd 

87.1 

43.9 

0 

90.9 

43.9 

87.1 

90.9 

on-road,  surface  Pd 

91.9 

40.7 

0 

96.5 

40.7 

91.9 

96.5 

off  road  FAR 

0.018 

0.012 

0.079 

0.029 

0.07 

0.085 

off-road,  subsurface  Pd 

63.2 

41.2 

82.4 

76.5 

83.8 

91.2 

off-road,  surface  Pd 

56.3 

62.5 

91.7 

83.3 

85.4 

93.8 

Socorro 

G 

M 

1 

GM 

Ml 

Gl 

TOTAL 

on-road  FAR 

0.033 

0.002 

0.003 

0.035 

0.004 

0.036 

0.037 

on-road,  subsurface  Pd 

88.5 

48 

0 

89.9 

48 

88.5 

89.9 

on-road,  surface  Pd 

100 

49 

20.8 

100 

59.4 

100 

100 

off  road  FAR 

0.063 

0.002 

0 

0.065 

0.002 

0.063 

0.065 

off-road,  subsurface  Pd 

80 

53.3 

0 

80 

53.3 

80 

80 

off-road,  surface  Pd 

100 

66.7 

22.2 

100 

72.2 

100 

100 

2.  Detection  Probability  Versus  Metal  Content  of  Mine 

Table  V-33  summarizes  GDE’s  detection  probability  versus  a  metal  content,  for 
on-  and  off-road,  surface  and  subsurface  conditions.  The  detection  probability  is  given  for 
all  sensors,  as  well  as  for  individual  sensor  types. 

Metal-cased  mines  were  detected  by  GDE  with  a  very  high  probability,  regardless 
of  the  depth  of  the  mine  and  the  test  site.  Its  EMI  sensor  was,  on  average,  the  best  sensor 
for  finding  the  metal  mines.  Its  GPR  performed  better  at  Socorro  at  detecting  metal  mines 
than  it  did  at  Aberdeen. 

Low-metal  mines  were  detected  with  a  higher  probability  when  they  were  placed 
on  ground  surface  compared  to  below  the  surface.  The  GPR  stood  out  as  the  dominant 
sensor  for  detecting  low-metal  mines.  The  IR  sensor,  even  when  it  was  operational,  never 
exceeded  a  58-percent  detection  probability  for  low-metal  mines  (this  was  in  the  surface, 
off-road  condition  at  Aberdeen). 


V-30 


Table  V-33.  GDE’s  Detection  Probability  vs.  Metal  Content  at  Aberdeen  and  Socorro 


GDE/Aberdeen 

On  Road 

Off  Road  i 

ALL 

GPR  EMI 

IR 

ALL 

z 

GPR 

EMI 

T 

IR 

M 

0.97 

0.86  0.97 

0 

1 

l 

1 

I 

0.71 

1 

— j— 
i 
i 

0.67 

Surface 

■B 

0.95  i  0 

i 

i 

0 

0.88 

i 

i 

0.83 

0.13 

i 

0.58 

1 

1  i  0 

0 

na 

i 

i 

i 

na 

na 

i 

i 

i 

na 

M 

0.95 

0.87  j  0.94 

0 

1 

S 

0.66 

1 

i 

i 

0.45 

Subsurface 

LM 

0.91 

0.91  j  0 

_ 

0 

0.8 

i 

i 

_ i 

0.57 

0.17 

"i  ~ 
i 

_ i _ 

0.37 

NM 

0.5 

i  0.5  ;  0 

0 

na 

1 

i 

_ i_ 

na 

— 

na 

r 

i 

i 

na 

nnP/QnrArrr\ 

On  Road 

Off  Road 

WWW  Wl 

>/VWI  1  V 

ALL 

|  GPR 

EMI 

X 

IR 

ALL 

GPR 

EMI 

IR 

M 

1 

i  i 

0.98 

j 

0.21 

1 

1 

1 

0.25 

Surface 

LM 

1 

j  1 

0 

0.21 

i 

1 

0 

0.17 

NM 

na 

]  na 

na 

i 

i 

na 

na 

na 

na 

na 

M 

1 

j  0.97 

1 

j 

0 

1 

1 

1 

0 

Subsurface 

LM 

0.77 

j  0.77 

0.02 

T" 

i 

_ _ L_. 

0 

0.57 

i  0.57 

0  i 

0 

NM 

1 

!  1 

0 

— f— 

i 

1 

0 

na 

I  na 

na  { 

na 

3.  Position  Resolution 

a.  On-Road  Tests 

Figure  V-ll  shows  the  GDE’s  miss-distance  distributions  in  the  on-road  tests  at 
Aberdeen.  Along  track,  the  mean  (bias)  of  the  distribution  is  9  cm,  while  the  RMS  is 
1 1  cm  (which  is  significantly  less  than  the  mean  radius  of  the  land  mines  used  in  this 
test).  Cross  track,  the  mean  is  -8  cm,  and  the  standard  deviation  is  21  cm  (slightly  larger 
than  the  mean  radius  of  land  mines  used  in  this  test).  Both  of  these  distributions  are 
clearly  normally  distributed,  as  expected.  The  slight  bias  in  the  along-track  distribution 
appears  to  be  caused  by  the  GPR  sensor  (see  Table  V-34).  There  are  no  significant  trends 
apparent  in  the  table;  that  is,  performance  of  individual  sensors  does  not  differ 
significantly  from  the  overall  performance,  and  there  is  no  dependence  on  mine  location 
(surface  or  subsurface).  The  data  from  the  on-road  tests  at  Socorro  are  similar  to  the 
results  at  Aberdeen. 
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GDE:  On-Road,  Along  Track  Positions  GDE:  On-Road,  Across-Track  Positions 


Figure  V-11.  GDE’s  Miss-Distance  Distribution  for  Surface  and  Subsurface  Mines  in  On 
Road  Tests  at  Aberdeen.  Data  points  include  the  GPR  and  EMI  sensors. 

The  solid  curve  is  a  best  fit  of  a  constant  plus  a  Gaussian. 


Table  V-34.  GDE  Bias  and  Resolution  Performance  at  Aberdeen  and  Socorro: 

On-Road  Performance 


Type 

Aberdeen  Position  Resolution 

Socorro  Position  Resolution 

Along-track 

Cross-track 

Along-track 

Cross-track 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

All  sensors, 
subsurface  +  surface 

0.09 

0.11 

-0.08 

0.21 

0.11 

0.16 

-0.14 

0.12 

All  sensors, 
subsurface 

0.09 

0.12 

-0.06 

0.22 

0.09 

0.17 

-0.14 

0.11 

GPR 

0.10 

0.12 

-0.06 

0.21 

0.09 

0.17 

-0.15 

0.11 

EMI 

0.06 

0.09 

-0.12 

0.20 

-0.01 

0.09 

-0.16 

0.11 

IR 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

All  sensors,  surface 

0.09 

0.10 

-0.10 

0.20 

0.13 

0.14 

-0.15 

0.13 

GPR 

0.10 

0.10 

-0.10 

0.20 

0.13 

0.14 

-0.15 

0.13 

EMI 

0.06 

0.08 

-0.12 

0.20 

0.02 

0.09 

-0.19 

0.14 

IR 

N/A 

N/A 

N/A 

N/A 

Not 
well  fit 

Not  well 
fit 

-0.11 

0.18 

b.  Off  Road 

Figure  V-12  shows  GDE’s  miss-distance  distribution  in  the  off-road  tests  at 
Aberdeen  for  GDE.  Along  track,  the  mean  (bias)  of  the  distribution  is  -4  cm,  while  the 
RMS  is  49  cm  (which  is  significantly  larger  than  the  mean  radius  of  land  mines  used). 
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However,  this  RMS  is  much  smaller  than  the  mine  halo,  so  it  would  likely  not  affect  the 
overall  Pd.  This  larger  measured  RMS  appears  to  be  caused  by  degradation  in  the 
resolutions  of  all  three  sensors  (see  Table  V-35).  However,  at  28  cm,  the  cross-track 
measurements  of  the  intrinsic  resolution  are  consistent  with  the  on-road  tests.  And  once 
again,  there  is  probably  no  bias  in  the  cross-track  position  measurements. 


GDE:  Off-Road,  Along-Track  Positions 


GDE:  Off-Road,  Across-Track  Positions 


Figure  V-12.  GDE’s  Miss-Distance  Distribution  for  Surface  and  Subsurface  Mines  in 

Off-Road  Tests  at  Aberdeen.  Data  points  include  GPR,  EMI,  and  IR  sensors. 

The  solid  curve  is  a  best  fit  of  a  constant  plus  a  Gaussian. 

Table  V-35  also  includes  the  results  from  the  off-road  tests  at  Socorro.  Although 
there  were  poor  statistics  at  Socorro,  the  data  in  this  Table  V-show  that  the  sensor  perfor¬ 
mance  off-road  did  not  differ  from  the  performance  at  Aberdeen. 

4.  Pj  and  RbIl0 

The  bias  and  RMS  resolution  performance  of  the  sensors  affect  how  well,  as  a 
function  of  Rhal0,  GDE’s  system  detects  the  mines.  Figure  V-13  shows  a  plot  of  Pd  versus 
Rhalo  for  the  tests  at  Aberdeen  and  Socorro.  These  figures  summarize  the  overall  implic¬ 
ation  of  GDE’s  bias  and  intrinsic  sensor  resolution  (as  tabulated  in  section  2). 

As  can  be  seen  from  the  plots,  the  detection  probability  for  GDE’s  sensors  was 
maximized  for  a  Rhalo  of  approximately  50  cm.  If  this  ATD  had  required  Rhi[0  to  be  as  small 
as  25  cm,  then  GDE’s  Pd  performance  would  have  been  somewhat  degraded,  particularly 
at  Aberdeen. 
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Table  V-35.  GDE  Bias  and  Resolution  Performance  at  Aberdeen  and  Socorro: 

Off-Road  Performance 


Aberdeen  Position  Resolution 

Socorro  Position  Resolution 

Type 

Along-track 

Cross-track 

Along-track 

Cross-track 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

All  sensors, 
subsurface  +  surface 

-0.04 

0.49 

-0.09 

0.28 

0.23 

0.28 

-0.12 

0.13 

All  sensors, 
subsurface 

-0.13 

0.32 

-0.07 

0.32 

0.12 

0.14 

-0.12 

0.16 

GPR 

-0.07 

0.37 

-0.10 

0.28 

0.12 

0.14 

-0.11 

0.16 

EMI 

-0.09 

0.22 

-0.09 

0.28 

0.01 

0.10 

-0.23 

0.09 

IR 

-0.49 

0.14 

0.00 

0.53 

N/A 

N/A 

N/A 

N/A 

All  sensors,  surface 

-0.10 

0.35 

-0.15 

0.22 

Not 
well  fit 

Not  well 
fit 

-0.10 

0.08 

GPR 

-0.05 

0.27 

-0.19 

0.20 

Not 
well  fit 

Not  well 
fit 

-0.10 

0.08 

EMI 

0.04 

0.09 

-0.16 

0.13 

Not 
well  fit 

Not  well 
fit 

-0.11 

0.02 

IR 

Not 
well  fit 

Not  well 
fit 

-0.08 

0.24 

Poor 

stats 

Poor 

stats 

Poor 

stats 

Poor 

stats 

5.  Additional  Runs 

a.  Aberdeen  Results 

Additional  runs  by  GDE  at  Aberdeen  include  two  night  runs  on  lane  1 1  and  one 
physical-marking  run  (resulting  in  one  PM  alarm  file)  on  lane  15.8  Table  V-36  shows  the 
cumulative  P £  and  FARs  for  the  on-road  day  runs,  and  the  night  runs  on  lane  1 1 .  The 
night  runs  resulted  in  Pjs  of  1.0  for  both  surface  and  subsurface  mines  and  the  false-alarm 
rate  was  considerably  less  than  for  the  day  runs.  GDE  did  not  use  its  IR  sensor  for  the  day 
runs.  At  night,  GDE’s  IR  sensor  detected  only  25  percent  of  the  surface  mines  and  none 
of  the  subsurface  mines. 


8  The  results  of  these  runs  are  summarized  in  Tables  B-6  and  B-8  in  Appendix  B  and  can  be  compared 
to  the  results  GDE  obtained  on  its  on-road  day  runs  on  lanes  1 1  and  15  as  shown  in  Tables  B-3  and 
B-5,  respectively. 
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d)  Off-road  at  Socorro 


Figure  V-13.  Pd  vs.  Rhal0  for  GDE’s  Sensor  Suite  at  Aberdeen  and  Socorro 
Table  V-36.  Comparison  of  GDE  On-Road  Day  and  Night  Runs  at  Aberdeen 


On-Road  Day 

Night 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

0.965 

0.909 

1.0 

1.0 

\RPd 

N/A 

N/A 

0.250 

0.0 

Total  FAR 

0.068  m'2 

0.015  m'2 

IR  FAR 

N/A 

0.000  m'2 

For  the  physical-marking  run  conducted  by  GDE  on  lane  15  at  Aberdeen,  only  a 
PM  file  was  produced.9  Table  V-37  compares  the  performance  measures  of  the  on-road 


9  The  results  of  these  runs  are  shown  in  Table  B-8. 
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day  runs  with  the  physical -marking  run  on  lane  15.  Notice  that  the  Pd  is  higher  and  the 
FAR  lower  for  the  PM  run  than  the  on-road  day  runs.  Furthermore,  referring  to  Table  V- 
B-5  in  Appendix  B,  we  see  that  for  the  on-road  day  runs  on  lane  15,  GDE  had  a  very  high 
FAR  of  0.101  m-2  on  its  first  run  and  a  FAR  of  0.047  m~2  on  its  second  run.  The  FAR  of 
GDE’s  second  on-road  day  run  on  lane  15  is  nearly  the  same  as  the  FAR  for  GDE’s  PM 
run  on  this  lane. 

Table  V-37.  Comparison  of  GDE  On-Road  Day  and  Physical-Marking  Runs  at  Aberdeen 


On-Road  Day  (EM) 

Physical  Marking  (PM) 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pa 

0.965 

0.909 

1.0 

1.0 

Total  FAR 

0.068  m'2 

0.042  m'2 

Table  V-38  compares  the  position  resolution  for  GDE’s  PM  run  on  lane  15  with 
the  position  resolution  of  the  on-road  day  runs  where  an  electronic-marking  system  was 
used.  For  the  along-track  direction,  the  RMS  is  about  three  times  larger  for  the  PM 
system,  while  the  mean  differs  by  13  cm.  In  the  cross-track  direction,  the  PM  location 
errors  are  half  the  magnitude  of  the  EM  location  errors. 


Table  V-38.  Comparison  of  GDE  Position  Resolution  for  On-Road  Day 
and  Physical-Marking  Runs  at  Aberdeen 


On-Road  Day  (EM) 

Physical  Marking  (PM) 

Mean  (m) 

RMS  (m) 

Mean  (m) 

RMS  (m) 

Along  Track 

0.09 

0.11 

-0.04 

0.29 

Cross  Track 

-0.08 

0.21 

-0.03 

0.10 

b.  Socorro  Results 

Additional  runs  by  GDE  at  Socorro  include  two  night  runs  on  lane  8,  two  morning 
runs  on  lane  4,  and  two  physical-marking  runs  (resulting  in  four  alarm  files — two 
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electronic-marking  and  two  physical-marking)  on  lane  8. 10  The  cumulative  Pjs  and  FARs 
for  the  on-road  day  rims,  and  the  night  runs  on  lane  8  are  shown  in  Table  V-39.  The  total 
P js  are  the  same  for  surface  mines  and  nearly  the  same  for  subsurface  mines.  The  total 
FAR  for  the  night  runs  is  about  half  the  rate  for  the  day  runs.  Note  that  GDE  only 
detected  surface  mines  with  its  IR,  and  that  the  IR  Pd  is  greater  at  night  than  at  day.  False- 
alarm  rates  for  the  IR  are  negligible. 

Table  V-39.  Comparison  of  GDE  On-Road  Day  and  Night  Runs  at  Socorro 


On-Road  Day 

Night 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.899 

1.0 

0.906 

\RPd 

0.208 

0.0 

0.5 

0.0 

Total  FAR 

0.037  m-2 

0.016  m-2 

IR  FAR 

0.003  m'2 

0.000  rtf2 

GDE  conducted  its  morning  tests  on  lane  4  between  5:00  A.M.  and  6:30  A.M. 
Table  V-40  shows  the  cumulative  Pd s  and  FARs  for  the  on-road  day  runs,  and  the 
morning  runs  on  lane  4.  All  the  surface  mines  were  detected  for  both  sets  of  tests,  and  the 
Pd  for  subsurface  mines  was  greater  for  the  morning  runs.  The  FAR  for  the  morning  runs 
was  extremely  low.  Examination  of  Table  V-B-10  in  Appendix  B  shows  that  in  general 
GDE  performed  well  on  lane  4.  In  fact  for  the  day  runs  on  lane  4,  there  was  only  one 
false  alarm  per  pass,  compared  to  three  and  five  false  alarms  for  the  two  morning  runs. 

For  the  two  physical -marking  runs  conducted  by  GDE  on  lane  8  at  Socorro,  both 
electronic-  and  physical-marking  files  were  produced.  The  results  of  these  runs  are  shown 
in  Table  V-B-20.  Table  V-41  compares  the  performance  measures  of  the  on-road  day 
runs  with  the  physical-marking  runs  on  lane  8.  The  Pd s  and  FARs  are  very  similar. 


10  The  results  of  these  runs  are  summarized  in  Tables  B-18,  B-20,  and  B-21  in  Appendix  B  and  can  be 
compared  to  the  results  GDE  obtained  on  its  on-road  day  runs  on  lanes  4  and  8  as  shown  in  Tables 
B-10  and  B-12,  respectively. 
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Table  V-40.  Comparison  of  GDE  On-Road  Day  and  Morning  Runs  at  Socorro 


On-Road  Day 

Morning 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.899 

1.0 

1.0 

Total  FAR 

0.037  m'2 

0.008  rrf2 

Table  V-41.  Comparison  of  GDE  On-Road  Day  and  Physical-Marking  Runs  at  Socorro 


On-Road  Day  (EM) 

Physical  Marking  (PM) 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.899 

1.0 

0.938 

Total  FAR 

0.037  rrf2 

0.028  rrf2 

Table  V-42  shows  comparisons  of  position  resolution  for  the  physical-marking 
runs  and  the  on-road  day  runs.  For  the  along-track  direction,  the  mean  and  standard 
deviation  are  greater  for  the  physical-marking  system.  The  physical-marking  system  has  a 
smaller  mean  and  standard  deviation  in  the  cross-track  direction  compared  to  the 
electronic-marking  system  used  in  the  on-road  day  tests,  but  the  differences  are  smaller 
than  the  along-track  differences. 


Table  V-42.  Comparison  of  GDE  Position  Resolution  for  On-Road  Day 
and  Physical-Marking  Runs  at  Socorro 


On-Road  Day  (EM) 

Physical  Marking  (PM) 

Mean  (m) 

RMS  (m) 

Mean  (m) 

RMS  (m) 

Along  Track 

0.11 

0.26 

Cross  Track 

-0.14 

0.10 

Table  V-43  shows  the  Pd s,  FARs,  and  number  of  alarms  for  the  two  physical¬ 
marking  runs.  The  results  of  the  electronic-marking  system  and  the  physical-marking 
system  for  the  same  pass  of  the  lane  are  shown  side  by  side.  For  each  EM/PM 


comparison,  the  P js  are  identical,  the  FARs  are  identical  for  the  second  pass  and  nearly 
identical  for  the  first  pass,  and  the  number  of  alarms  differ  by  only  one.  The  magnitude  of 
the  difference  between  the  number  of  physical  marks  and  the  number  of  electronic  marks 
was  smallest  for  GDE  compared  to  the  other  contractors. 

Table  V-43.  Comparison  of  GDE  Lane  8  Physical-Marking  Runs  (EM  and  PM)  at  Socorro 


EM-1 

PM-1 

EM-2 

PM-2 

p„ 

0.958 

0.958 

0.958 

0.958 

FAR  (rrf2) 

0.016 

0.018 

0.039 

0.039 

#  Alarms 

50 

51 

70 

69 

E.  GEOCENTERS  (GeoC)  PERFORMANCE 

1.  Individual  Sensor  and  Sensor  Pair  Performance 

As  shown  in  Table  V-44,  the  GeoC  system  found  100  percent  of  the  surface 
mines  during  the  ATD.  GeoC’s  subsurface  detection  was  at  or  better  than  the  90-percent 
level,  except  for  the  off-road  lane  at  Socorro,  where  Pd  was  70  percent. 

The  GPR  was  clearly  the  overall  best  sensor  for  detection.  At  Socorro,  there  was 
no  marginal  benefit  from  the  EMI  and  IR  sensors,  while  at  Aberdeen,  the  EMI  and  IR 
sensors  contributed  in  only  a  small  way  to  the  overall  Pd.  Note,  however,  that  almost  all 
of  the  false  alarms  were  contributed  by  the  GPR — at  their  worst  the  combined  EMI  and 
IR  sensors  tallied  a  false-alarm  rate  that  was  just  over  14  percent  of  the  GPR’s  (this 
occurred  on-road  at  Aberdeen).  Hence,  the  EMI  and  IR  sensors  only  contributed 
positively  to  the  system  as  a  whole. 

2.  Detection  Probability  Versus  Metal  Content  of  Mine 

Table  V-45  summarizes  GeoC’s  detection  probability  versus  metal  content,  for  on 
and  off  road,  surface  and  subsurface.  The  detection  probability  is  given  for  all  sensors,  as 
well  as  for  individual  sensor  types. 
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Table  V-44.  GeoC’s  False-Alarm  Rates  and  Detection  Probabilities  Listed  for  Individual 
Sensors,  Sensor  Pairs,  and  the  Total  System.  Results  from  the  Aberdeen  and  Socorro 
sites  are  listed  separately.  False-alarm  rates  are  quoted  in  the  units  m'2,  and  detection 
probabilities  are  given  in  percent.  G,  M,  and  I  refer  to  GPR,  EMI,  and  IR,  respectively. 


GeoC 


Aberdeen 

G 

M 

1 

GM 

Ml 

Gl 

TOTAL 

on-road  FAR 

0.048 

0.008 

0 

0.056 

0.008 

0.056 

on-road,  subsurface  Pd 

97.7 

44.7 

0 

98.5 

44.7 

97.7 

98.5 

on-road,  surface  Pd 

96.5 

43 

98.8 

100 

98.8 

100 

100 

off  road  FAR 

0.065 

0.0008 

0 

0.066 

0.0008 

0.065 

0.066 

off-road,  subsurface  Pd 

89.7 

44.1 

0 

89.7 

44.1 

89.7 

89.7 

off-road,  surface  Pd 

97.9 

47.9 

100 

97.9 

100 

100 

100 

Socorro 

G 

M 

1 

GM 

Ml 

Gl 

TOTAL 

on-road  FAR 

0.032 

0.0002 

0.0003 

0.032 

0.0005 

0.032 

0.032 

on-road,  subsurface  Pd 

91.2 

47.3 

17.6 

91.2 

59.5 

91.2 

91.2 

on-road,  surface  Pd 

100 

50 

83.3 

100 

91.7 

100 

100 

off  road  FAR 

0.035 

0 

0 

0.035 

0 

0.035 

0.035 

off-road,  subsurface  Pd 

70 

53.3 

0 

70 

53.3 

70 

70 

off-road,  surface  Pd 

100 

66.7 

94.4 

100 

94.4 

100 

100 

Table  V-45.  GeoC’s  Detection  Probability  vs.  Metal  Content  at  Aberdeen  and  Socorro 


GeoC/Aberdeen 

On  Road 

Off  Road 

ALL  | 

GPR  | 

EMI 

_T_ 

IR 

ALL 

GPR 

mssm 

IR 

M 

i  ! 

0.92  | 

0.97 

— 1 
i 

1 

1 

1 

0.96 

1 

Surface 

mem 

i  i 

1  ; 

0.05 

i 

0.98 

1 

0.96 

0 

1 

NM 

i  i 

1  i 

0 

i 

1 

na 

na 

na 

na 

M 

i  i 

i  i 

0.94 

i 

i 

0 

1 

1 

0.79 

0 

Subsurface 

mssm 

0.97  ! 

0.95  j 

0.02 

i 

i 

-j— 

0 

0-77  ; 

_ 2. _ 

0 

m 

""T . \" 

0 

T 

i 

l 

0 

na 

i  na 

na 

na 

GeoC/Socorro 

On  Road 

Off  Road 

ALL 

GPR 

EMI 

IR 

ALL  | 

GPR 

EMI 

IR 

1 

1 

1 

0.83 

1  | 

1 

1 

1 

Surface 

LM 

1 

i 

0 

0.83 

1  | 

1 

0 

0.83 

NM 

na 

na 

na 

na 

na  i 

na 

na 

na 

M 

1 

1 

1 

.  0.11 

i  i 

1 

i  i 

0 

Subsurface 

LM 

0.86 

|  0.86  j 

0 

!  0.27 

0.36  j 

0.36 

[ _ £ _ 

NM 

0.71 

!  0.71  j 

0 

0.07 

na  • 

na 

[  na 

j  na 

All  metal-cased  mines  were  found  by  GeoC.  Both  its  EMI  and  GPR  sensors  were 
very  effective  at  finding  the  metal  mines.  Their  IR  sensor  performed  well  on  metal-cased 
mines  that  were  located  on  the  surface,  except  at  Socorro. 

Surface,  low-metal  mines  were  detected  with  a  higher  probability  than  subsurface, 
low-metal  mines.  The  GPR  sensor  was  the  best  sensor  for  the  detection  of  low-metal 
mines,  averaged  over  all  conditions.  The  IR  sensor  performed  about  as  well  as  the  GPR 
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for  the  surface  condition  at  Aberdeen,  but  did  not  perform  as  well  in  the  surface  condition 
at  Socorro  or  for  subsurface  conditions  at  either  site. 

3.  Position  Resolution 

a.  On  Road 

Figure  V-14  shows  GeoC’s  miss-distance  distribution  in  the  on-road  tests  at 
Aberdeen.  Along  track,  the  mean  (bias)  of  the  distribution  is  -16  cm.  This  bias  appears  to 
be  real,  albeit  overstated  because  the  data  are  not  well  fit  by  a  Gaussian  distribution.  This 
bias  appears  to  be  caused  by  the  measured  locations  of  the  surface  mines,  regardless  of 
the  sensor.  The  RMS  along  track  is  24  cm,  which  is  slightly  more  than  the  mean  radius  of 
the  land  mines  used  in  this  test.  Cross  track,  the  mean  is  4  cm  and  the  RMS  is  9  cm, 
significantly  less  than  the  mean  radius  of  land  mines.  Table  V-46  summarizes  the  means 
and  RMSs,  broken  down  by  surface  and  subsurface  mines,  as  well  as  by  sensor.  There  are 
no  significant  trends  in  the  sensor  performance,  although  there  is  a  dependence  on  mine 
location  (surface  or  subsurface). 

The  results  from  the  on-road  tests  at  Socorro,  also  shown  in  the  table,  were 
different  from  the  Aberdeen  results  in  an  important  respect:  the  measurements  of  the 
mine  locations  were  unbiased,  and  the  RMS  was  smaller. 


meter  meter 


Figure  V-14.  GeoC’s  Miss-Distance  Distribution  for  Surface  and  Subsurface  Mines  in  On- 
Road  Tests  at  Aberdeen.  Data  points  include  the  GPR,  EMI,  and  IR  sensors. 

The  solid  curve  is  the  best  fit  of  a  constant  plus  a  Gaussian. 


V-41 


Table  V-46.  GeoC  Bias  and  Resolution  Performance  at  Aberdeen  and  Socorro: 

On-Road  Performance 


Aberdeen  Position  Resolution 

Socorro  Position  Resolution 

Type 

Along-track 

Cross-track 

Along-track 

Cross-track 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

All  sensors, 
subsurface  +  surface 

-0.16 

0.24 

0.04 

0.09 

-0.07 

0.16 

0.03 

0.12 

All  sensors, 
subsurface 

-0.08 

0.11 

0.04 

0.09 

-0.05 

0.15 

0.02 

0.13 

GPR 

-0.10 

0.10 

0.04 

0.08 

-0.03 

0.13 

0.01 

0.11 

EMI 

-0.05 

0.09 

0.04 

0.09 

-0.07 

0.16 

0.03 

0.14 

IR 

N/A 

N/A 

N/A 

N/A 

Not 
well  fit 

Not  well 
fit 

0.01 

0.20 

All  sensors,  surface 

-0.20 

0.24 

0.05 

0.08 

-0.09 

0.16 

0.03 

0.11 

GPR 

-0.11 

0.23 

0.03 

0.07 

-0.04 

0.14 

0.02 

0.09 

EMI 

-0.21 

0.21 

0.05 

0.07 

-0.09 

0.15 

0.03 

0.11 

IR 

-0.32 

0.18 

0.04 

0.10 

Not 
well  fit 

Not  well 
fit 

0.04 

0.13 

b.  Off  Road 

Figure  V-15  shows  GeoC’s  miss-distance  distribution  for  surface  and  subsurface 
mines  in  off-road  tests  at  Aberdeen.  Along  track,  the  mean  (bias)  of  the  distribution  is 
-12  cm,  which  is  similar  to  the  on-road  test.  At  14  cm,  the  intrinsic  resolution  along  track 
is,  however,  better  than  in  the  on-road  test.  The  cross-track  measurements  again  appear  to 
have  no  bias,  and  at  14  cm,  the  RMS  is  consistent  with  the  on-road  tests.  The  bias  in  the 
along-track,  off-road  test  appears  to  be  primarily  due  to  the  performance  of  all  sensors. 
Other  results  for  the  sensors  are  tabulated  in  Table  V-46,  including  the  measurements 
from  the  off-road  tests  at  Socorro.  Note  that  these  Socorro  results  do  not  show  statis¬ 
tically  significant  differences  from  the  off-road  performance  at  Aberdeen. 
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GeoC:  Off-Road,  Along-Track  Positions 


GeoC:  Off-Road,  Across-Track  Positions 


Figure  V-15.  Results  of  the  Measured  Surface  and  Subsurface  Mine  Locations 
for  the  GeoC  Off-Road  Tests  at  Aberdeen.  Data  from  the  GPR,  EMI, 
and  IR  sensors  are  included  in  these  plots. 


Table  V-47.  GeoC  Bias  and  Resolution  Performance  at  Aberdeen:  Off-Road  Performance 


Aberdeen  Position  Resolution 

Socorro  Position  Resolution 

Type 

Along-track 

Cross-track 

Along-track 

Cross-track 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

Mean 

(bias) 

(m) 

Standard 

Deviation 

(RMS) 

(m) 

All  sensors, 
subsurface  +  surface 

-0.12 

0.13 

0.03 

0.14 

-0.08 

0.17 

0.02 

0.11 

All  sensors, 
subsurface 

-0.10 

0.12 

0.04 

0.14 

-0.05 

0.14 

0.03 

0.13 

GPR 

-0.13 

0.11 

0.01 

0.12 

-0.05 

0.15 

-0.03 

0.12 

EMI 

-0.05 

0.08 

0.04 

0.15 

-0.05 

0.15 

0.03 

0.14 

IR 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

All  sensors,  surface 

-0.14 

0.14 

0.02 

0.14 

-0.12 

0.21 

0.01 

0.09 

GPR 

-0.12 

0.14 

-0.01 

0.12 

-0.01 

0.22 

-0.02 

0.10 

EMI 

-0.09 

0.09 

0.02 

0.15 

-0.07 

0.15 

0.06 

0.06 

IR 

-0.14 

0.11 

0.05 

0.14 

Not 
well  fit 

Not  well 
fit 

0.03 

0.07 

4.  Pd  and  RMo 

The  bias  and  RMS  resolution  performance  of  the  sensors  affect  how  well,  as  a 
function  of  i?hal0,  GeoC’s  system  detects  the  mines.  Figure  V-16  shows  a  plot  of  Pd  versus 
i?ha|o  for  the  tests  at  Aberdeen  and  Socorro.  These  figures  summarize  the  overall 
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implication  of  GeoC’s  relatively  small  bias  and  intrinsic  sensor  resolution  (as  tabulated  in 
section  2 ). 

GeoC 


i 


0.8 


T3  0.6 
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0.4 
0.2 
0 

0  0.2  0.4  0.6  0.8  1 

a)  On-road  at  Aberdeen 

1 

0.8 


T3 

Pk 

0.4 


0.2 


0 

0  0.2  0.4  0.6  0.8  1 

Rhalo  (m> 


^halo  (®) 


Subsurface 

Surface 


c)  Off-road  at  Aberdeen 


d)  Off-road  at  Socorro 


Figure  V-16.  Pd  vs.  Rhal0  for  GeoC’s  Sensor  Suite  at  Aberdeen  and  Socorro 

As  can  be  seen  from  the  plots,  the  detection  probability  for  GeoC’s  sensors  was 
maximized  for  a  i?hal0  of  approximately  30  cm.  If  this  ATD  had  required  i?hal0  to  be  as  small 
as  25  cm,  then  GeoC’s  Pd  performance  would  have  likely  been  unchanged.  Even  if  i?hal0 
were  as  small  as  15  cm,  GeoC  would  have  likely  still  met  the  Pd  exit  criteria  for  this 
ATD. 


5.  Additional  Runs 

a.  Aberdeen  Results 

Additional  runs  by  GeoC  at  Aberdeen  include  two  night  runs  on  lane  11,  two  tele- 
operated  runs  on  lane  11,  and  one  physical-marking  run  (resulting  in  two  files — one  EM 
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alarm  file  and  one  PM  alarm  file)  on  lane  12. 11  Table  V-48  shows  the  cumulative  Pjs  and 
FARs  for  the  on-road  day  runs  and  the  night  runs.  GeoC  detected  all  the  surface  mines  for 
each  set  of  tests,  and  the  IR  sensor  detected  all  but  one  of  the  surface  mines  during  the 
day  runs.  For  both  day  and  night  runs,  the  IR  did  not  detect  any  of  the  subsurface  mines. 
The  false-alarm  rates  for  the  night  runs  were  almost  50  percent  less  than  for  the  day  runs. 
No  IR  false  alarms  occurred  during  the  day  or  night. 

Table  V-48.  Comparison  of  GeoC  On-Road  Day  and  Night  Runs  at  Aberdeen 


On-Road  Day 

Night 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.985 

1.0 

1.0 

IR  Pd 

0.988 

0.0 

1.0 

0.0 

Total  FAR 

0.056  m"2 

0.033  m"2 

IR  FAR 

0.000  in"2 

0.000  nr2 

For  the  tele-operated  runs,  GeoC  made  two  passes  of  lane  11.  Table  V-49  shows 
the  cumulative  results  of  those  passes  and  the  on-road  day  runs.  The  P/  are  1.0  for  the 
surface  mines,  and  the  subsurface  Pd s  differ  by  only  1  to  2  percent  from  the  surface  P js. 
The  false-alarm  rate  for  the  tele-operated  runs  is  less  than  for  the  on-road  day  runs. 

Table  V-49.  Comparison  of  GeoC  On-Road  Day  and  Tele-operated  Runs  at  Aberdeen 


On-Road  Day 

Tele-operated 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.985 

1.0 

1.0 

Total  FAR 

0.056 

0.015  m"2 

1 1  The  results  of  these  runs  are  summarized  in  Tables  B-6  and  B-7  in  Appendix  B  and  can  be  compared 
to  the  results  GeoC  obtained  on  its  on-road  day  runs  on  lanes  1 1  and  12  as  shown  in  Tables  B-3  and 
B-4,  respectively. 
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For  the  physical -marking  run  conducted  by  GeoC  on  lane  12  at  Aberdeen,  both 
electronic  and  physical-marking  files  were  produced.12  Table  V-50  compares  the  per¬ 
formance  measures  of  the  on-road  day  runs  with  the  physical-marking  run  on  lane  12. 
The  subsurface  Pd  for  the  physical-marking  run  is  slightly  lower  than  for  the  day  runs, 
and  the  FAR  is  also  lower. 

Table  V-50.  Comparison  of  GeoC  On-Road  Day  and  Physical-Marking  Runs  at  Aberdeen 


On-Road  Day  (EM) 

Physical  Marking  (PM) 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.985 

1.0 

0.913 

Total  FAR 

0.056  m"2 

0.038  nrf2 

Table  V-51  shows  that  the  along-track  position  resolution  was  better  for  the 
physical-marking  run  than  for  the  on-road,  day  runs.  The  cross-track  resolutions  differ 
only  slightly. 


Table  V-51.  Comparison  of  GeoC  Position  Resolution  for  On-Road  Day 
and  Physical-Marking  Runs  at  Aberdeen 


On-Road  Day  (EM) 

Physical  Marking  (PM) 

Mean  (m) 

RMS  (m) 

Mean  (m) 

RMS  (m) 

Along  Track 

-0.16 

0.24 

-0.02 

0.10 

Cross  Track 

0.04 

0.09 

0.0 

0.09 

Similar  performance  was  found  for  the  physical-marking  system  when  directly 
compared  to  the  electronic-marking  system  for  the  same  pass  of  lane  12  at  Aberdeen  (see 
Table  V-52).  The  Pd s  are  the  same,  the  PM  FAR  is  slightly  less  than  the  EM  FAR,  and  the 
number  of  alarms  is  about  10  percent  less  for  the  physical-marking  system. 


12  The  results  of  this  run  are  shown  in  Table  B-7. 
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Table  V-52.  Comparison  of  GeoC  Lane  12  Electronic-Marking  and 
Physical-Marking  Runs  (EM  and  PM)  at  Aberdeen 


EM-1 

PM-1 

0.946 

0.946 

FAR  (rrf2) 

0.042 

0.038 

#  Alarms 

112 

102 

b.  Socorro  Results 

Additional  runs  by  GeoC  at  Socorro  include  one  night  run  on  lanes  11,12,  and  13, 
two  tele-operated  runs  on  lane  8,  and  two  physical-marking  runs  (resulting  in  four 
files — two  EM  alarm  files  and  two  PM  alarm  files)  on  lane  8. 13  Table  V-53  shows  the 
cumulative  and  FARs  for  the  on-road  day  runs,  and  the  night  runs  on  lanes  1 1, 12,  and 
13.  During  the  day,  all  surface  mines  were  detected,  with  the  IR  sensor  detecting  83 
percent.  Over  90  percent  of  the  subsurface  mines  were  detected  for  the  day  runs,  but  less 
than  20  percent  of  these  were  detected  by  the  IR  sensor.  This  result  differs  from  the 
results  at  Aberdeen  where  the  IR  Pd  was  zero  for  subsurface  mines.  At  night,  the  total  Pd 
was  1.0  for  surface  mines,  and  the  IR  sensor  detected  all  of  them.  For  subsurface  mines  at 
night,  the  total  Pd  dropped  off  only  slightly,  but  the  IR  sensor  did  not  detect  any  mines. 
The  total  FAR  for  the  night  runs  was  nearly  the  same  as  the  day  FAR,  and  the  IR  FAR 
was  zero  for  both  test  conditions. 


*3  The  results  of  these  runs  are  summarized  in  Tables  B-20  through  B-24  in  Appendix  B  and  can  be 
compared  to  the  results  GeoC  obtained  on  its  on-road  day  runs  on  lanes  8,  11,  12,  and  13  as  shown  in 
Tables  B-12  through  B-15,  respectively. 
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Table  V-53.  Comparison  of  GeoC  On-Road  Day  and  Night  Runs  at  Socorro 


On-Road  Day 

Night 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.912 

1.0 

0.839 

\RPd 

0.833 

0.176 

1.0 

0.0 

Total  FAR 

0.032  m’2 

0.029  m’2 

IR  FAR 

0.000  m’2 

0.000  rrf2 

GeoC  tele-operated  performance  at  Socorro  (see  Table  V-54)  closely  matches  the 
performance  trends  observed  at  Aberdeen.  The  surface  Pd s  are  the  same,  and  the  sub¬ 
surface  P js  differ  slightly.  Again,  the  FAR  for  the  tele-operated  runs  is  less  than  for  the 
day  runs. 

Table  V-54.  Comparison  of  GeoC  On-Road  Day  and  Tele-operated  Runs  at  Socorro 


On-Road  Day 

Tele-operated 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.912 

1.0 

0.906 

Total  FAR 

0.032  m’2 

0.019  m’2 

For  the  physical-marking  runs  conducted  by  GeoC  on  lane  8  at  Socorro,  both 
electronic-  and  physical-marking  files  were  produced.  Table  B-20  shows  the  results  of 
this  run.  Table  V-55  compares  the  performance  measures  of  the  on-road  day  runs  with 
the  physical -marking  runs  on  lane  8.  The  subsurface  Pd  for  the  physical-marking  run  is 
slightly  lower  than  for  the  day  runs,  and  the  FAR  is  also  lower. 
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Table  V-55.  Comparison  of  GeoC  On-Road  Day  and  Physical-Marking  Runs  at  Socorro 


On-Road  Day 

Physical  Marking  (PM) 

Surface 

Subsurface 

Surface 

Subsurface 

Total  Pd 

1.0 

0.912 

1.0 

0.844 

Total  FAR 

0.032  nrf2 

0.022  irf2 

Table  V-56  shows  that  the  along-track  position  resolution  as  measured  by  the 
RMS  was  worse  for  the  physical-marking  run  compared  to  the  on-road  day  runs,  although 
the  mean  was  less.  The  cross-track  resolutions  differ  only  slightly. 

Similar  performance  was  found  for  the  physical-marking  system  when  directly 
compared  to  the  electronic-marking  system  for  the  same  pass  of  lane  8  at  Socorro  (see 
Table  V-57).  The  P js  are  the  same,  the  PM  FAR  is  slightly  less  than  the  EM  FAR,  and  the 
number  of  PM  alarms  is  less  than  the  number  of  EM  alarms. 


Table  V-56.  Comparison  of  GeoC  Position  Resolution  for  On-Road  Day 
and  Physical-Marking  Runs  at  Socorro 


On-Road  Day 

Physical  Marking  (PM) 

Mean  (m) 

RMS  (m) 

Mean  (m) 

RMS  (m) 

Along  Track 

-0.07 

0.16 

0.01 

0.31 

Cross  Track 

0.03 

0.12 

0.01 

0.08 

Table  V-57.  Comparison  of  GeoC  Lane  8  Physical-Marking  Runs  (EM  and  PM)  at  Socorro 


EM-1 

PM-1 

EM-2 

PM-2 

P* 

0.875 

0.833 

1.0 

0.958 

FAR  (m~2) 

0.021 

0.016 

0.033 

0.028 

#  Alarms 

64 

50 

79 

68 
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VI.  CONCLUSIONS 


The  following  general  conclusions  can  be  drawn  from  the  VMMD  ATD  results: 

1.  The  exit  criteria  were  typically  met  by  a  majority  of  contractors  at  each  test 
site,  the  exceptions  being  the  on-road  FAR  at  Aberdeen  (met  only  by  one 
contractor)  and  the  off-road,  subsurface  Pd  at  Socorro  (again,  met  by  one 
contractor). 

2.  Reduction  of  the  FAR  is  one  of  the  serious  challenges  for  this  program,  as  the 
ultimate  (ORD)  requirements  on  FAR  are  substantially  below  those  achieved 
in  this  ATD. 

3.  The  contractors’  GPR  sensors  were,  overall,  the  most  effective  sensors  for 
the  detection  of  AT  mines.  The  GPRs  also,  generally,  contributed  the  most 
false  alarms  of  the  three  sensor  types. 

4.  Subsurface,  low-metal  mines  in  off-road  conditions  seemed  to  be  the  most 
difficult  mines  to  detect  in  this  ATD. 

5.  Metal-cased  AT  mines  were  detected  with  a  high  probability.  Both  GPR  and 
EMI  sensors  were  effective  at  finding  these  mines  at  the  depths  tested  in  this 
ATD. 

6.  Surface  mines  were  detected  with  a  high  probability.  Both  GPR  and  IR 
systems  were  effective,  regardless  of  the  metal  content  of  the  mine. 

7.  The  along-track  and  cross-track  position  resolutions  typically  achieved 
suggest  that  the  mine  halo  can  be  reduced  from  1  m  without  eliminating  real 
detections. 
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GLOSSARY 


AT 

antitank 

ATC 

Aberdeen  Test  Center 

ATD 

Advanced  Technology  Demonstration 

ATR 

Automatic  Target  Recognition 

CDC 

Computing  Devices  Canada 

CRC 

Coleman  Research  Corp. 

dGPS 

differential  Global  Positioning  System 

EG&G 

EG&G,  Inc. 

EMI 

electromagnetic  induction 

FAR 

false-alarm  rate 

GDE 

GDE  Systems,  Inc. 

GeoC 

Geo-Centers,  Inc. 

GPR 

Ground-Penetrating  Radar 

GSTAMIDS 

Ground  Standoff  Mine  Detection  System 

HMMWV 

high-mobility  multipurpose  wheeled  vehicle 

NVESD 

U.S.  Army  Night  Vision  and  Electronic  Sensors  Directorate 

ORD 
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APPENDIX  A 


DESCRIPTION  OF  CONTRACTOR  SYSTEMS 

A.  COMPUTING  DEVICES  CANADA  (CDC) 

The  CDC  VMMD  system  has  a  3-m  wide  detection  system  mounted  on  a  Remote 
Detection  Vehicle  (RDV).  This  system  was  adapted  from  an  existing  Improved  Landmine 
Detection  System  design  developed  for  the  Canadian  Forces  by  Defence  Research  Estab¬ 
lishment  Suffield  and  CDC.  The  system  includes  a  GPR  sensor,  an  EMI  minimum  metal 
detector,  a  forward-looking  IR  detector  and  a  thermal  neutron  activation  (TNA)  detector. 
The  GPR,  EMI,  and  IR  detectors  operate  independently,  and  their  data  is  combined  in  a 
central  processor.  Confirmation  of  detected  land  mines  is  provided  by  the  TNA  detector. 
Tele-operation  and  remote  control  are  done  in  a  command  vehicle,  which  follows  the 
RDV.  A  visible-light  camera  is  mounted  on  top  of  the  RDV  to  assist  the  control  vehicle 
operator  with  the  navigation  of  the  RDV. 

A  telemetry  link,  including  data  processing  and  a  radio  link,  enables  communi¬ 
cation  between  the  RDV  and  the  command  vehicle. 

The  GPR  subsystem  is  a  3-m  wide  antenna  mounted  70  cm  above  the  ground 
surface  in  front  of  the  RDV.  The  specifications  of  this  system  are  proprietary. 

The  EMI  subsystem  consists  of  24  transmitter/receiver  pairs  of  coils  in  three  1-m 
trays  mounted  on  a  sensor  platform  in  front  of  the  GPR  system.  It  is  used  to  detect  all  AT 
land  mines  with  metal  content.  The  24  transmit/receive  coils  are  connected  with  a  con¬ 
troller  that  collects  the  data  and  interfaces  with  the  central  fusion  system. 

The  IR  system  is  a  9-14  pm  IR  camera  mounted  on  a  boom  in  front  of  the  RDV. 
It  is  used  to  detect  both  buried  and  surface  mines.  The  camera  collects  images  as  the 
RDV  moves  forward,  and  these  images  are  processed  for  fusion  in  the  integration 
processor. 

The  TNA  system  is  a  land  mine  confirmation  sensor  developed  by  SAIC  Canada. 
The  RDV  tows  the  sensor  on  a  trailer.  It  is  used  to  confirm  the  presence  of  explosives  in 
suspected  land  mines  found  by  the  other  sensors.  The  sensor  contains  Californium 
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(CF-252),  which  acts  as  a  high-energy  neutron  source.  As  the  neutrons  are  slowed  down 
(thermalized),  they  are  captured  by  the  nuclei  in  the  soil  and  the  target,  and,  in  particular, 
by  the  nitrogen  present  in  modem  explosives.  If  nitrogen  is  present,  then  characteristic 
10.8  MeV  photons  will  be  emitted  from  the  nitrogen  nucleus,  which  is  detected  by  scintil¬ 
lating  material  in  the  sensor.  By  collecting  all  the  high-energy  photons  emitted  from  the 
target  and  surrounding  material  and  searching  for  the  characteristic  peak  in  energy  around 
10.8  MeV,  the  presence  of  nitrogen,  and  therefore  explosives,  is  confirmed. 

The  data  are  processed  and  fused  in  a  central  integration  processor.  The  data  from 
one  or  more  of  the  GPR,  EMI,  or  IR  sensors  are  processed  to  provide  a  confidence  level 
for  detection.  A  potential  detection  of  a  land  mine  in  any  one  system  is  correlated  with 
the  navigation  system.  The  position  is  computed  using  a  combination  of  navigation, 
attitude  of  the  sensor,  and  dGPS  data.  If  the  confidence  level  of  a  potential  detection  is 
significant,  then  the  TNA  confirmation  sensor  is  positioned  over  the  suspected  land  mine 
and  the  RDV  stops.  If  the  TNA  confirms  the  presence  of  explosive,  the  system  declares  a 
detection,  the  data  are  recorded,  and  the  position  is  marked  (both  physically  and 
electronically). 

B.  COLEMAN  RESEARCH  CORPORATION  (CRC) 

The  CRC  system  has  a  3-m  wide  swath  detection  system  mounted  on  a 
HMMWV.  The  system  includes  a  frequency-stepped  GPR  subsystem,  an  EMI  metal 
detector,  and  an  IR  sensor  suite.  CRC’s  IR  sensor  was  not  used  in  this  ATD.  Each  of  the 
sensors  has  its  own  electronics  suite  for  the  processing  of  data  and  automatic  target 
detection.  The  data  are  combined  in  a  central  processing  unit,  which  also  controls  the  data 
storage  and  the  electronic  and  the  physical  marking.  In  addition,  a  driving  camera  (visible 
light)  is  mounted  on  the  HMMWV  to  remotely  display  the  view  to  the  vehicle’s  driver. 
The  vehicle  is  not  tele-operated. 

The  GPR  subsystem  comprises  an  array  of  33  antennas  (16  transmitting,  17 
receiving).  It  is  used  to  detect  all  types  of  AT  land  mines.  It  is  mounted  on  a  frame  in 
front  of  the  HMMWV  covering  a  3-m  swath.  The  antennas  are  arranged  with  two  receiv¬ 
ing  antennas  around  each  transmitting  antenna  (with  most  receiving  antennas  servicing 
the  two  adjacent  transmitting  antennas).  The  transmitters  step  in  20  MHz  frequency  steps, 
from  900  MHz  to  2.7  GHz.  The  measurement  rate  is  28  Hz. 

Data  are  processed  in  a  DSP  board.  The  processing  includes  classification  of 
targets  and  background,  which  scores  the  detections.  If  a  mine  is  detected  by  the  GPR, 
the  data  are  passed  forward  to  a  spatial  processor  for  location  analysis  and  marking. 
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The  EMI  subsystem  comprises  six  metal  detectors.  It  is  used  to  detect  high-metal- 
content  AT  land  mines.  It  is  mounted  on  the  frame  in  front  of  the  GPR  antenna  array.  The 
six  metal  detectors  are  spaced  equally  and  cover  a  3-m  width  swath.  The  subsystem 
pulses  at  a  rate  of  70  Hz. 

Data  are  processed  independently  from  the  rest  of  the  system.  When  the  EMI 
subsystem  detects  a  land  mine,  the  data  are  passed  forward  to  the  spatial  processor  for 
location  analysis  and  marking. 

The  IR  subsystem,  which  was  not  used  in  this  ATD,  comprises  two  IR  cameras: 
one  cooled  IR  camera  covering  3-5  pm,  and  one  room-temperature  IR  camera  covering 
7-14  pm.  The  system  is  used  to  detect  all  types  of  AT  land  mines.  It  is  mounted  on  a 
boom  from  the  roof  of  the  vehicle.  Both  cameras  take  data  continually,  at  a  frame  rate  of 
30  Hz.  The  field  of  view  covers  a  3  by  5  m  swath  in  front  of  the  vehicle. 

Data  are  processed  in  a  PowerPC.  The  algorithms  filter  the  images  and  search  for 
features  for  subsequent  classification.  When  the  subsystem  detects  a  land  mine,  the  data 
are  passed  forward  to  the  spatial  processor  for  location  analysis  and  marking. 

Processing  of  the  data  is  done  independently  by  each  sensor  suite.  Data  are  fused 
by  a  simple  logical  OR  of  the  results.  A  spatial  processor  correlates  the  results  from  the 
sensors  with  a  dGPS,  records  the  data,  and  electronically  and  physically  marks  the  mine 
locations. 

C.  EG&G 

The  EG&G  VMMD  system  has  a  3-m  swath  system  of  three  sensors.  The  system 
includes  a  ground-penetrating  radar  (GPR)  subsystem,  a  pulsed  electromagnetic  induction 
(EMI)  metal  detector,  and  an  optical  system  that  includes  two  infrared  cameras  and  a 
visible-light  camera.  The  system  resides  on  a  HMMWV:  the  GPR  and  EMI  systems  are 
on  a  sensor  platform  on  the  front  of  the  vehicle  and  the  optical  system  is  mounted  on  the 
roof.  Each  of  the  three  subsystems  operates  independently  with  its  own  automated  target 
recognition  algorithm;  data  are  fused  in  an  integration  processor.  The  processor  also 
tracks  the  vehicle  and  sensor  position  using  a  global  positioning  system  (GPS)  and  serves 
as  a  controller  for  the  electronic  and  physical  marking  of  detectors.  The  vehicle  may  be 
remotely  operated  using  the  JPO  UGV  Standard  Tele-operation  System  (STS). 

The  GPR  system  includes  nine  identical  GPR  modules  mounted  on  the  sensor 
platform,  angled  forward  at  45  degrees.  The  system  is  used  to  detect  all  types  of  AT  land 
mines.  Each  GPR  module  uses  ultra- wide  bandwidth  (UVB)  radar  signals  for  the 
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detection  of  buried  land  mines.  Each  module  contains  separate  transmitting  and  receiving 
impulse-radiating  antennas  that  can  transmit  and  receive  impulses  of  about  300  ps 
(effective  bandwidth  of  250  MHz  to  5  GHz).  These  unipolar  300  ps  impulses  have  a  10  V 
amplitude,  with  a  repetition  rate  of  5  MHz.  The  received  signals  are  amplified  and 
sampled.  A  single  GPR  controller  unit  provides  all  timing  and  control,  including  the 
triggering  control  for  the  transmission  and  sampling  of  signals.  Operation  of  the  GPR 
modules  is  interleaved  so  that  cross  talk  is  minimized. 

As  the  VMMD  moves  forward  GPR  data  are  collected  every  3  in.,  as  measured  by 
a  tickwheel.  A  two-dimensional  picture  is  built,  based  on  along-track  and  depth  measure¬ 
ments  (energy  returns  which  depend  on  depth).  Background  information  is  also  collected 
and  subtracted  from  the  raw  data.  The  real-time  GPR  processor  collects  single-channel 
energies  and  mark  messages,  as  well  as  resolves  cross-channel  issues.  The  cross-track 
dimension  of  mine  locations  is  found  by  interpolating  among  adjacent  channels. 

The  pulsed-EMI  system  also  includes  nine  identical  transmitter/receiver  modules 
across  the  width  of  the  sensor  platform.  This  system  is  used  to  detect  AT  land  mines  with 
a  high  metal  content.  This  system  is  located  in  front  of  the  GPR  system,  and  each  EMI 
module  lies  in  a  node  of  the  radar  system.  Each  EMI  module  transmits  an  ultra-wide 
bandwidth,  pulsed  magnetic  field  (30  psec  pulse  width)  through  a  coil  and  detects  and 
analyzes  the  eddy  current  decays  present  in  high-metal-content  land  mines.  The  magnetic 
field  generator  can  create  waveforms  of  specific  shapes,  strengths,  and  polarization,  so 
that  they  can  be  localized  to  the  area  of  interest.  All  transmitters  on  the  nine  modules  are 
excited  simultaneously  so  that  they  act  as  a  single  transmitter  coil.  Cross  talk  between 
modules  and  from  transmitters  is  minimized  in  the  receivers  (mostly  by  correct  geometric 
placement  of  the  receivers). 

EMI  data  are  collected  every  3  in.  The  receivers  measure  the  eddy  current 
response  of  metal  mines,  and  the  resulting  signal  is  analyzed  by  a  real-time  processor  for 
features  such  as  amplitude  responses  and  decay  time.  This  measurement  is  scored  against 
a  library  of  signals,  which  contains  features  of  metal  AT  mines  as  well  as  innocuous 
objects.  The  processor  also  interpolates  the  cross-track  data  among  adjacent  channels 
before  declaring  the  mine. 

The  optical  system  includes  three  cameras  mounted  on  the  top  of  the  vehicle.  The 
system  is  used  to  detect  all  types  of  AT  land  mines,  both  buried  and  surface.  The 
effective  width  of  the  viewing  area  is  4  m  for  each  camera.  Two  of  the  cameras  are 
infrared  (3-5  and  8-12  pm  bandwidth)  and  one  is  a  color,  visible  light  camera.  The 
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infrared  cameras  are  used  to  detect  both  buried  and  surface  mines  while  the  visible-light 
camera  is  used  to  detect  surface  mines.  Data  from  each  of  the  cameras  is  collected 
continually  (subject  to  the  frame  rate).  The  infrared  cameras  are  cooled  to  reduce  noise. 
All  three  cameras  are  controlled  with  a  central  processor,  which  processes  and  analyzes 
the  images.  For  the  infrared  system,  the  processed  images  are  filtered,  and  features  such 
as  shape  and  size  are  extracted  from  mine-like  objects  for  further  characterization.  The 
images  from  the  visible  camera  are  processed  and  analyzed  for  mine-like  characteristics 
based  on  shape,  size,  and  color.  Any  one  of  the  three  camera  systems  can  declare  a  mine. 

If  any  one  subsystem  detects  a  mine,  then  the  central  processor  controls  the 
electronic  and  physical  marking  of  the  mine.  Data  such  as  mine  location  [the  differential 
GPS  (dGPS)  corrects  for  antenna  tilts]  are  saved,  as  well  as  the  raw  sensor  information. 

D.  GDE  SYSTEMS 

The  GDE  VMMD  system  has  a  3-m  swath  of  sensors.  The  system  includes  a  GPR 
subsystem,  a  pulsed-EMI  metal  detector,  and  an  IR  camera.  Each  of  the  systems  operates 
independently  with  its  own  automated  target  recognition  algorithm;  data  are  fused  and 
land  mines  marked  by  an  integration  processor.  The  processor  also  tracks  the  vehicle 
using  a  dGPS,  tracks  the  sensor  position,  and  serves  as  a  controller  for  the  electronic  and 
physical  marking  of  mines.  The  vehicle  may  be  remotely  operated  using  the  JPO  UGV 
STS. 

The  GPR  system  comprises  five  independent  GPR  antenna  arrays.  It  is  used  to 
detect  all  types  of  AT  land  mines.  Each  array  includes  two  transmitter/receiver  pairs.  The 
array  is  a  stepped-frequency,  bistatic  antenna  operating  between  0.5  and  3.0  GHz.  As  the 
vehicle  moves  forward,  data  are  collected  and  stored.  A  real-time,  digital  signal  process¬ 
ing  (DSP)  post-processor  analyzes  the  data  for  anomalies  and  discriminates  land  mines 
from  clutter. 

The  pulsed-EMI  system  includes  six  identical  coil  antennas  across  the  width  of 
the  sensor  platform.  This  system  is  used  to  detect  high-metal-content  AT  land  mines.  The 
system  is  located  in  front  of  the  GPR  system  in  a  non-metal  housing.  The  EMI  detects  the 
eddy-current  response  to  pulses.  Each  EMI  detector  is  successively  interrogated  for 
anomalies  by  a  central  processor. 

The  IR  system  includes  an  8-12  pm  IR  camera  mounted  on  top  of  the  vehicle.  It 
is  used  to  detect  surface  and  near-surface  land  mines.  The  field  of  view  is  3.1  by  1.5  m 
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ahead  of  the  sensor  platform.  The  camera  is  used  as  a  forward-looking  sensor  to  search 
for  anomalies  for  discrimination. 

The  information  from  all  three  sensors  is  fused  in  the  system’s  control  using 
automatic  integrated  target  recognition.  As  the  vehicle  moves  forward  and  the  sensors 
collect  data,  features  such  as  size,  shape,  depth,  metal  content,  burial  depth,  and  electrical 
properties  are  extracted  from  the  data.  The  fusion  algorithm  uses  these  features  to  build  a 
three-dimension  picture  of  targets,  which  allow  the  detection  of  land  mines  and  discrimi¬ 
nation  from  clutter.  The  targets  are  scored  and  the  data  are  saved  only  for  positive  (land 
mine)  detections.  The  position  of  land  mines  is  physically  marked,  and  electronically 
marked  using  a  GPS  system. 

E.  GEOCENTERS  (GeoC) 

The  GeoC  VMMD  system  has  a  3.5-m  swath  detection  system  (maximum 
response  within  3-m)  mounted  on  a  HMMWV.  The  system  includes  a  GPR  subsystem,  a 
pulsed-EMI  metal  detector,  and  an  IR  sensor.  Each  of  the  systems  operates  independently 
with  its  own  automated  target  recognition  algorithm;  data  are  combined  in  an  integration 
processor.  This  processor  also  tracks  the  vehicle  and  sensor  positions  using  a  GPS  and 
serves  as  a  controller  for  electronic  and  physical  marking.  The  vehicle  is  equipped  with 
the  JPO  UGV  STS. 

The  GPR  subsystem  is  an  energy-focusing  radar  that  comprises  an  integrated 
array  of  radar  transmitters  and  receivers,  controlling  electronics,  communications  hard¬ 
ware,  and  a  rack-mounted  PC.  It  is  used  to  detect  all  types  of  AT  land  mines.  It  is  located 
on  a  sensor  platform  in  front  of  the  HMMWV.  The  array  comprises  three  ~l-m  wide 
array  modules,  each  containing  five  pulsed  transmitters,  five  sampled  receivers,  and  a 
custom  digital  signal-processing  board.  Each  array  module  raster-scans  the  ground, 
focusing  the  combined  energy  spatially  into  the  ground  (into  a  voxel)  from  incremented 
sets  of  four  transmitters.  The  sampling  of  the  receivers  is  gated  to  correspond  to  the  timed 
response  from  the  specific  volume  in  the  ground.  Each  raster  scan  from  the  three  antenna 
modules  is  70  voxels  (3  m)  across  by  64  voxels  (~46  cm)  deep.  Successive  raster-scans 
every  2  in.  (driven  by  a  tick  wheel)  are  collected  and  added  together  to  build  up  a  three- 
dimensional  picture  of  the  ground.  The  pulsed,  transmitted  waveform  has  a  bandwidth  of 
0.7— 1.3  GHz,  and  the  received  signals  are  sampled  up  to  1  Msample/second  (bandwidth 
of  3  GHz). 

As  the  vehicle  moves  forward,  raster-scan  data  are  acquired.  The  background  is 
calculated  and  subtracted,  and  the  three-dimensional  energy-return  response  is  analyzed 
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using  a  fuzzy-logic,  feature-extraction  algorithm.  The  integration  processor  uses  these 
feature  scores  to  calculate  a  confidence  level  result  in  real  time.  Confidence  levels, 
locations  of  potential  mine  targets,  and  the  raw  data  are  saved. 

The  pulsed-EMI  system  includes  six  transmitter/receiver  coils  located  in  front  of 
the  GPR  system.  It  is  used  to  detect  high-metal-content  AT  land  mines.  The  six  coils  are 
connected  to  six  sets  of  electronic  boards  operating  in  a  master/slave  mode.  This  mode 
allows  one  coil  system  to  operate  as  a  master  and  the  other  five  as  a  slave  using  the 
master’s  trigger,  ensuring  correct  synchronization.  Each  coil  operates  at  a  75-Hz 
repetition  rate  and  84  W  peak-power  output.  The  data  are  sampled  every  2  in.  A  two- 
dimensional  picture  of  land  mines  is  built  up  from  the  six  coils  as  the  vehicle  moves 
forward. 

As  data  are  acquired,  the  background  (primarily  induced  by  the  metal  signature  of 
the  vehicle)  is  subtracted  and  the  energy  return  results  compared  with  a  pre-set  threshold. 
The  EMI  computer  cross-correlates  data  from  adjacent  channels  and  extracts  features 
(such  as  shape  and  size)  from  the  data.  This  allows  the  refinement  of  the  location  and 
confidence  level  for  the  marking  of  high-metal-content  land  mines.  The  confidence 
levels,  locations  and  raw  data  are  saved. 

The  IR  subsystem  is  a  3-5  pm  cooled  infrared  camera  mounted  on  the  roof  of  the 
vehicle.  The  system  is  used  to  detect  all  types  of  AT  land  mines.  Data  from  the  camera  is 
collected  continually.  The  camera  is  controlled  from  a  central  processing  unit,  although 
its  pointing  calibration  is  performed  semi-automatically.  The  images  are  collected  and 
subtracted  from  the  background.  A  feature  extraction  algorithm  calculates  a  confidence 
level  for  each  target. 

The  integration  processor  combines  the  data  from  all  three  systems  using  the 
calculated  confidence  levels  and  feature  values.  A  target  confidence  is  calculated  based 
on  current  data,  statistics  extracted  from  previous  data,  expert  input,  and  algorithms  that 
process  features.  If  the  integration  processor  declares  a  mine-like  target,  the  location  is 
calculated  using  the  integrated  GPS  system,  the  tick-wheel,  and  information  about  the 
attitude  of  the  detecting  sensor.  The  results  are  electronically  and  physically  marked. 
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TEST  RESULTS 


B-l 


C A 

PQ  H 

X  J 


on 

o3 

£ 

d 

C 


D 

co 

D 

13 

o 

• 

T3 

a 

»  rH 

X 
D 
D 

XI 
O 


o  o  K 

fc  tS  & 

O  cJ 

8  £ 
5  §  £ 

•o  u  e 

a  x  § 

*  8  fi 

a  D  cd 

D  co  ^ 

-p  C  ^ 

fc  2  ^ 

*5  -!-»  > 

^  (D  O 

X  ^  X 

^  2  3 

£  s  « 

b  '&  4 

«  ®2  o 


1— 1 

o 

1 

GO 

D 

z 

H 

W 

PP 

Ph 

H 

X 

CO 

D 

< 

w 

j3 

H 

CO 

s 

8 

4-> 

X 

a 

<u 

£ 

4> 

N 

*s 

s 

I 

co 

^t 

(N 

i 

PQ 

X 

OX) 

P 

1 


PQ 

CO 

JD 

*8 

H 


PQ 


jd 

T3 


d 


X) 

d 

T3 

§ 

c3 

(D 

2 

O 

OX) 

lo 

C 

J2 

3 

X 

.2 

%— » 

§ 

-4-i 

o 

§ 

Pi 

CD 

+-> 

o 

X 

d 

T3 

<4-1 

o 

D 

<D 

+-» 

D 

OX) 

’co 

c 

T3 

O 

D 

Ph 

— — 1 

CD 

X 

CD 

X 

D 

X 

4— » 

CD 

-4-* 

<41 

t-f 

CD 

g 

O 

> 

x 

C 2 

►> 

4-» 

C 

13 

£ 

i 

s 


^D 

13 


£  3 


03 


03 


S  .52 


B-3 


Table  B-1.  Lane  2  Results  at  Aberdeen 
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Table  B-2.  Lane  4  Results  at  Aberdeen 
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Table  B-4.  Lane  12  Results  at  Aberdeen 
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Table  B-6.  Lane  11  Night,  Tele-operated,  and  Physical-Marking  Results  at  Aberdeen 
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Table  B-9.  Lane  1  Results  at  Socorro 
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Table  B-10.  Lane  4  Results  at  Socorro 
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Table  B-11.  Lane  6  Results  at  Socorro 
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Table  B-13.  Lane  11  Results  at  Socorro 


</) 

ro 

o 

1- 

a 

o 

T — 

o 

o 

o 

o 

5 

o 

o 

o 

o 

o 

-T— 

o 

■t — 

O 

o 

o 

o 

t— 

o 

o 

o 

o 

10/10  | 

10/10 

10/10  1 

8/10 

9/10 

10/10 

10/10 

10/10 

t— 

<D 

-Q 

E 

=3 

z 

cr 

=3 

o: 

% 

CO 

c 

o 

O 

I 

s 

\ 

S 

% 

S 

a 

s 

N 

\ 

S 

S 

S 

19/19 

CO 

to 

03 

CO 

CM 

o 

T— 

0.037 

I 

\ 

s 

\ 

S 

S 

a 

s 

S 

s 

s 

S 

18/19 

CO 

m- 

00 

CO 

|  0.947 

0.027 

GDE-2  | 

s 

S 

s 

S 

% 

\ 

\ 

17/19 

r- 

CO 

o 

o 

v— 

|  0.895 

0.021 

GDE-1  j 

s 

\ 

S 

S 

% 

s 

S 

\ 

19/19 

CO 

CO 

03 

5* 

CO 

q 

T— 

9800 

18/19 

00 

oo 

CM 

in 

CM 

|  0.947 

0.058 

1 

1 

S 

s 

S 

S 

s 

\ 

s 

19/19 

03 

m 

03 

O 

CM 

o 

CM 

o 

r* 

0.042 

CM 

• 

O 

a: 

o 

s 

S 

S 

s 

\ 

N 

\ 

a 

s 

s 

19/19 

112 

03 

CO 

(N 

r- 

CO 

o 

0.054 

CRC-1  ' 

s 

a 

s 

s 

S 

s 

19/19 

CO 

03 

03 

CO 

co 

o 

CO 

CO 

o 

d 

S 

s 

\ 

S 

s 

s 

s 

s 

\ 

s 

18/19 

CO 

CO 

CO 

M- 

- 

M’ 

03 

O 

0.029 

O 

Q 

a 

\ 

S 

s 

s 

S 

S 

N 

s 

19/19 

tT 

CO 

03 

T— 

- 

q 

03 

CM 

O 

o 

lO 

r- 

CM 

Surface 

in 

CM 

Surface 

Surface 

Surface 

in 

Surface 

CM 

in 

in 

Surface 

Surface 

Totals 

Alarms 

Detections 

False  Alarms 

Multiple  Hits 

qT 

FAR  (nr2) 

0) 

Q. 

H 

0) 

c 

2 

CO 

2 

1- 

M15I 

TM62P 

TM62P 

CM 

i 

LU 

03 

T— 

s 

o> 

i 

1 

CM 

CO 

2 
1— 

2 

CM 

CD 

2 

h- 

<: 

TM62M1 

M15 

M15 

2 

CM 

CO 

2 

a— 

M19I 

TM62MI 

Q 

CM 

CO 

tT 

in 

CO 

CD 

CM 

CO 

M- 

in 

CO 

CO 

03 

o 

CO 

m- 

r> 

o 

o 

o 

o 

o 

o 

r* 

CM 

CM 

CM 

CM 

<D 

o 

o 

o 

o 

o 

o 

o 

O 

o 

O 

o 

o 

o 

o 

O 
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O 

o 

O 

T— 

T— 

5 

T“ 

r— 
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*— 

T— 

r— 

T— 
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Contractor/Run  Number 


10/10  i 

10/10 

10/10 

10/10  I 

10/10 

10/10  I 

10/10 

9/10  . 

10/10 

o 

o 

r— 

c D 

10/10 

O 

o 

9/10 

10/10 

s 

s 

s 

% 

\ 

S 

14/15 

m 

CO 

CO 

0.933 

6900 

s 

s 

s 

s 

S 

s 

S 

S 

13/15 

o> 

CO 

CO 

o 

CD 

0.867 

0900 

s 

s 

s 

\ 

s 

s 

s 

S 

s 

\ 

13/15 

CO 

CO 

o> 

T— 

- 

h- 

CD 

CO 

o 

890  0 

s 

s 

S 

s 

\ 

S 

13/15 

in 

CO 

CO 

CM 

05 

|  0.867 

o 

o 

d 

s 

s 

s 

s 

N 

s 

s 

% 

s 

s 

15/15 

m 

r— 

CM 

- 

o 

t- 

0.064 

s 

s 

S 

s 

s 

14/15 

TT 

T*** 

05 

CO 

0.933 

CO 

LO 

o 

d 

s 

s 

s 

s 

\ 

s 

s 

% 

13/15 

CO 

uo 

CO 

05 

T— 

CO 

0.867 

0.027 

\ 

s 

S 

s 

s 

15/15 

r- 

in 

m 

05 

h- 

CM 

o 

0.027 

s 

s 

s 

s 

s 

s 

15/15 

05 

CO 

m 

CM 

CM 

CM 

o 

Z900 

s 

1 

s 

s 

s 

s 

s 

s 

% 

13/15 

CM 

CO 

r- 

CM 

CM 

0.867 

0.082 

Surface 

in 

CM 

Surface 

CM 

1  -r— 

CM 

Surface 

CO 

CM 

Surface 

in 

Surface 

Totals 

Alarms 

Detections 

False  Alarms 

Multiple  Hits 

CL 

k 

5 

TM62M  | 

Ml  51  ! 

TM62M  | 

TM46 

TM62M 

TM62MI  | 

M15 

EM12 

TM62P 

TM62P 

TMA4 

TMA4 

M19 

M19I 

M19I 

o 

o 

CM 

CM 

O 

O 

CM 

CO 

o 

o 

CM 

12004 

in 

o 

o 

CM 

T — 

r- 

o 

o 

CM 

■t — 

CO 

o 

o 

CM 

cr> 

o 

o 

CM 

|  12010 

o 

CM 

CM 

T— 

o 

CM 

|  12013 

1  12016 

12019 

B-18 


Table  B-15.  Lane  13  Results  at  Socorro 


aj 

|2 

o 

o 

x— 

o 

o 

o 

o5 

o 

05 

o 

o> 

7/10  1 

10/10 

o 

X— 

o 

r— 

O 

O 

o 

o 

o 

o 

T— 

o 

o 

8/10  | 

10/10  1 

10/10 

10/10 

7/10 

10/10 

Contractor/Run  Number 

GEO-2 

N 

s 

S 

\ 

S 

S 

S 

S 

% 

S 

17/18 

oo 

in 

h- 

05 

T— 

CM 

CM 

|  0.944 

0.040 

O 

LU 

O 

S 

s 

S 

s 

s 

s 

S 

s 

18/18 

T- 

lO 

00 

OO 

in 

o 

X— 

oo 

CO 

o 

6 

s 

S 

s 

s 

s 

S 

s 

s 

s 

00 

T— 

00 

00 

in 

00 

CM 

CO 

00 

o 

Z900 

GDE-1 

s 

s 

17/18 

CO 

1^ 

o 

r- 

0.944 

CM 

O 

o 

EGG-2 

S 

s 

s 

I 

s 

s 

13/18 

in 

m 

CO 

GO 

CM 

|  0.722 

0.058 

EGG-1 

% 

I 

s 

s 

\ 

s 

s 

s 

\ 

17/18 

in 

CD 

05 

CM 

O) 

r- 

0.944 

0900 

CM 

i 

O 
a : 
o 

s 

s 

s 

s 

S 

s 

s 

16/18 

oo 

oo 

CO 

T— 

CM 

CM 

o 

m 

O) 

OO 

00 

o 

0.046 

% 

s 

S 

s 

s 

17/18 

CM 

00 

r- 

M- 

CO 

CO 

M- 

M- 

O) 

o 

0.071 

CDC-2 

s 

% 

s 

s 

1 

% 

s 

s 

s 

18/18 

05 

CM 

00 

00 

CO 

q 

o 

d 

T — 

6 

Q 

O 

% 

s 

s 

\ 

% 

oo 

00 

3 

00 

X— 

CM 

in 

q 

0.044 

Depth  (in.) 

to 

CM 

Surface 

Surface 

Surface 

CM 

I 

CM 

CM 

8 

■t 

3 

CO 

to 

8 

€ 

w 

iq 

8 

t 

w 

Surface 

CO 

Surface 

Totals 

Alarms 

Detections 

False  Alarms 

Multiple  Hits 

0? 

fji 

E 

cc 

5 

a> 

CL 

P 

a> 

c 

1 

TM62MI 

TM62MI 

TMA4 

M15 

3 

2 

1- 

to 

i 

TM46 

CM 

r— 

5 

LU 

05 
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Ml  91 

05 

i 

05 

i 

TM62MI 

TM62P 

TM62M 

9 

<d 

a 
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CO 

CM 

O 

O 

CO 

t— 

CO 

o 

o 

CO 

T"“ 

o 

o 

CO 

T- 

uO 

o 

o 

CO 

co 

o 

o 

CO 

h- 

o 

o 

CO 

GO 

O 

O 

CO 
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05 

O 

o 

CO 

o 

o 

CO 

CO 

o 

CO 

T— 

CO 

o 

CO 

05 

O 

CO 

x- 

CM 

CM 

O 

CO 

x— 
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CM 

o 
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T— 

M- 

CM 

o 

CO 

13025 

13026 
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Totals 

10/10 

1/10  1 

io/io  ! 

10/10 

10/10 

10/10  1 

10/10 

10/10 

3/10  1 

10/10 

10/10 

io/io  ! 

2/10 

io/io  i 

4/10  | 

10/10  1 

io/io  ; 

| 

10/10 

9/10 

Contractor/Run  Number 

GEO-2 

% 

\ 

\ 

S 

s 

% 

s 

% 

20/24 

CM 

in 

o 

CM 

CO 

CD 

0.833 

00 

o 

o 

GEO-1  1 

s 

s 

1 

s 

S 

s 

S 

19/24 

in 

a> 

CO 

CO 

CM 

|  0.792 

0.022 

GDE-2  1 

s 

s 

S 

s 

s 

s 

S 

s 

s 

S 

s 

s 

20/24 

CO 

in 

o 

CM 

M- 

T— 

CD 

j  0.833 

0.052 

GDE-1  | 

s 

s 

s 

s 

s 

\ 

s 

\ 

s 

s 

s 

22/24 

o 

CM 

CM 

CM 

CM 

|  0.917 

0.078 

EGG-2  | 

% 

s 

% 

s 

% 

s 

19/24 

o 

CD 

CD 

O 

CM 

CM 

j  0.792 

M- 

o 

d 

EGG-1  [ 

s 

s 

s 

s 

s 

S 

s 

s 

20/24 

m- 

o 

CM 

- 

CO 

CO 

CO 

00 

o 

o 

d 

CRC-2 

s 

1 

s 

s 

s 

\ 

s 

% 

s 

s 

s 

22/24 

CO 

CD 

CM 

CM 

CO 

m 

in 

1  0.917 

o 

to 

o 

d 

O 

QC 

O 

s 

s 

s 

s 

s 
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s 

s 

s 

18/24 

CO 

CO 

CO 

r- 

m 
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0.022 

CM 

6 

o 

o 

S 

s 

s 

s 

% 

% 

% 

s 

s 

% 

20/24 

CM 

O 

CM 

CO 

r* 
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|  0.833 
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6 
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s 
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1 

1 

1 
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o 
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CO 

in 

00 

o 
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o 

CO 

o 

d 
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Surface 

CM 

in 

8 
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3 
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CO 

1 

Surface 

Surface 
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M- 

CO 

1 
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I 

Surface 

M- 
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False  Alarms 
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1- 

CD 

i 

M15 

2 

CM 

CO 

2 

1- 

5 

TM62M 

m 

T“ 

2 

2 

CM 

to 

2 

H 

TM62P 

2 

CM 

CO 

5 

H 

CD 

T— 

2 

TM46 

CL 

CM 

to 

? 

CD 

T— 

S 

M15 

S 

CM 

CO 

2 

1- 

2 

CM 

to 

2 

CM 

to 

h- 

TM62P 

M19 

Mine  ID 

o 

o 

to 

CM 

O 

O 

CO 

T— 

CO 

o 

o 

to 

o 

o 

CD 

in 

o 

o 

CO 

T— 

CO 

o 

o 

to 

T— 

CD 

o 

o 

to 

— 

o 

o 

CO 

r~ 

T— 

r* 

O 

CD 

CM 

o 

to 

CO 

o 

to 

r— 

M- 

r— 

O 

CO 

m 

o 

CO 

T— 

to 

o 

CD 

h- 

r* 

O 

CO 

T— 

o 

CM 

o 

to 

T— 

CM 

O 

to 

CM 

CM 

O 

to 

m 

CM 

O 

CO 

T— 

to 

CM 

O 

to 

CM 

o 

CO 

y— 

CO 

CM 

O 

to 

[  16029 

16030 

B-20 


Table  B-17.  Lane  4  Physical-Marking  Results  at  Socorro 

|  |  Contractor/Run  Number 

Mine  ID  Mine  Type  Depth  (in.)  EGG-EM1  I  EGG-PM1  I  EGG-EM2  I  EGG-PM2  I  EGG-EM3  1  EGG-PM3  Totals 
4001  EM12  2  ✓✓✓✓✓✓  6/6 
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1 

w 

S 

o 

00 

CO 

00 

Contractor/Run  Number 

eg 

S 

t 

UJ 

Q 

CD 

S 

S 

S 

S 

S 

17/17 

CM 

00 

r^ 

f— 

CD 

o 

o 

o 

o 

d 

GDE-M1  1 

s 

S 

S 

N 

S 

s 

s 

17/17 

n- 

CM 

CO 

_ 

h- 

q 

CD 

o 

o 

o 

CRC-M2  1 

s 

s 

S 

S 

S 

\ 

s 

s 

16/17 

CD 

CD 

CO 

T— 

CM 

o> 

0.941 

0.041 

CRC-M1  | 

s 

S 

S 

s 

s 

s 

s 

s 

17/17 

LO 

1^- 

CO 

tr* 

CD 

q 

0.031 

CRC-N2  | 

s 

s 

s 

s 

s 

S 

s 

S 

s 

s 

\ 

\ 

17/17 

O 

CD 

1^ 

T— 

CD 

CD 

o 

0.031 

CRC-N1  | 

s 

s 

s 

s 

% 

s 

s 

S 

s 

\ 

s 

s 

s 

\ 

17/17 

O 

h- 

h- 

O 

r— 

CO 

q 

o 

CM 

O 

d 

EGG-N3  | 

s 

s 

s 

s 

s 

\ 

s 

s 

17/17 

O 

M- 

N- 

T— 

CD 

q 

CO 

x~ 

o 

d 

CM 

z 

6 

CD 

UJ 

\ 

\ 

s 

s 

% 

s 

s 

% 

16/17 

O 

CD 

CD 

CO 

CM 

t— 

|  0.941 

0.045 

Depth  (in.) 

CM 

CM 

j 

i q 

CM 

Surface 

M- 

Surface 

Surface 

Surface 

CM 

Surface 

Surface 

ID 

Surface 

Totals 

Alarms 

Detections 

|  False  Alarms 

Multiple  Hits 
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Table  B-19.  Lane  6  Night,  Morning  and  Tele-operated  Results  at  Socorro 


Totals 
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5/6  | 

9/9 

9/9 

CD 

in 

CO 

CD 

CD 

CD 

CO 

CD 

CD 

CD 

CD 

|  9/9 

. . jg_J 

6/6 

1 

1 

Contractor/Run  Number 
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Table  B-20.  Lane  8  Physical-Marking  Results  at  Socorro 

Contractor/Run  Number 
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to 

(O 

c 

to 

E 

£ 

ro 
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FAR  (m-2)  0.021  0.016  0.033  0.028  0.018  0.018  0.056  0.028  [  0.016  [  0.018  |  0.039  |  0.039 
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APPENDIX  C 


TABLES  OF  PROBABILITIES  OF  DETECTION  AND 
FALSE-ALARM  RATES  CATEGORIZED  BY  SENSOR 
TYPE  AND  METAL  CONTENT  OF  MINES 
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APPENDIX  C 

TABLES  OF  PROBABILITIES  OF  DETECTION  AND 
FALSE-ALARM  RATES  CATEGORIZED  BY  SENSOR 
TYPE  AND  METAL  CONTENT  OF  MINES 


Tables  C-l  through  C-102  summarize  the  probabilities  of  detections  (PJ  and  false 
alarm  rates  (FAR)  for  subsurface  and  surface  mines  for  a  variety  of  conditions:  on-road, 
off-road,  night,  physical-marking,  teleoperated,  and  morning.  The  statistics  are  compiled 
for  each  sensor  (GPR,  EMI,  and  IR),  sensor  pairs  (GPR-EMI,  EMI-IR,  GPR-IR),  and  all 
sensors.  The  sensor  pairs  are  for  either  sensor  alone  or  both  sensors  together.  “All 
Sensors”  refers  to  one  or  more  sensors  either  individually  or  together.  The  Pjs  are 
subcategorized  according  to  metal  content  of  the  mines:  Total  (all  mines),  M  (metal),  LM 
(low  metal),  and  NM  (nonmetal). 

The  tables  are  organized  by  contractor  (CDC,  CRC,  EG&G,  GDE,  and 
GeoCenters)  and  test  location  [Aberdeen,  Socorro,  and  Combined  (Aberdeen  and 
Socorro].  For  the  “Combined”  cases,  only  the  statistics  for  the  on-road  and  off-road  tests 
were  given.  For  each  contractor,  the  tables  are  presented  in  the  following  order,  as 
applicable: 

•  On-road,  subsurface 

•  On-road,  surface 

•  Off-road,  subsurface 

•  Off-road,  surface 

•  Night,  subsurface 

•  Night,  surface 

•  Physical-marking,  EM,  subsurface 

•  Physical-marking,  EM,  surface 

•  Morning,  subsurface 

•  Morning,  surface 

•  Tele-operated,  subsurface 

•  Tele-operated,  surface 


C-3 


For  the  physical-marking  tests,  only  the  EM  statistics  are  given  here,  since  no 
information  was  available  on  which  sensor  detected  the  mines  for  the  PM  cases.  See 
Appendix  B  for  a  description  of  physical-marking  (EM  and  PM)  runs. 

“N/A”  (not  applicable)  means  that  particular  type  of  mine  was  not  used  for  the 
test  under  the  conditions  specified  by  the  table  header. 

A.  CDC 

1.  Aberdeen 


Table  C-1.  CDC,  Aberdeen  On-Road,  Subsurface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

All  Sensors 

Pd,  Total 

0.909 

0.606 

0.720 

0.932 

0.871 

0.924 

0.932 

Pd,  M 

0.984 

0.984 

0.726 

1.000 

1.000 

0.984 

1.000 

P*  LM 

0.828 

0.281 

0.688 

0.859 

0.734 

0.859 

0.859 

Pd,  NM 

1.000 

0.167 

1.000 

1.000 

1.000 

1.000 

1.000 

FAR 

0.039 

0.029 

0.012 

0.053 

0.036 

0.045 

0.054 

Table  C-2.  CDC,  Aberdeen,  On-Road,  Surface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.942 

0.628 

1.000 

0.965 

1.000 

1.000 

1.000 

Pd,  M 

0.944 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

1.000 

0.932 

1.000 

1.000 

1.000 

Pd,  NM 

1.000 

0.167 

1.000 

1.000 

1.000 

1.000 

1.000 

FAR 

0.039 

0.029 

0.012 

0.053 

0.036 

0.045 

0.054 

Table  C-3.  CDC,  Aberdeen,  Off-Road,  Subsurface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.927 

0.647 

0.838 

0.941 

0.882 

0.985 

0.985 

Pd,  M 

0.974 

1.000 

0.947 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

0.867 

0.200 

0.700 

0.867 

0.733 

0.967 

0.967 

P, ,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.040 

0.021 

0.008 

0.049 

0.027 

0.041 

0.050 
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Table  C-4.  CDC,  Aberdeen,  Off-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

All  Sensors 

P„  Total 

1.000 

0.604 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  M 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

0.208 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.008 

0.049 

0.027 

0.041 

0.050 

Table  C-5.  CDC,  Aberdeen,  Night,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

P&  Total 

0.950 

0.725 

0.600 

0.975 

0.900 

0.975 

0.975 

P«  M 

1.000 

1.000 

0.667 

1.000 

1.000 

1.000 

1.000 

LM 

0.900 

0.550 

0.550 

0.950 

0.850 

0.950 

0.950 

P„  NM 

1.000 

0.000 

0.500 

1.000 

0.500 

1.000 

1.000 

FAR 

0.038 

0.030 

0.012 

0.055 

0.035 

0.044 

0.055 

Table  C-6.  CDC,  Aberdeen,  Night,  Surface,  Pjs  and  FARs 


2.  Socorro 


Table  C-7.  CDC,  Socorro,  On-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P„  Total 

0.811 

0.588 

0.696 

0.885 

0.858 

0.865 

0.892 

P „  M 

0.900 

1.000 

0.743 

1.000 

1.000 

0.971 

1.000 

P„  lm 

0.719 

0.219 

0.625 

0.781 

0.703 

0.750 

0.781 

P„  NM 

0.786 

0.214 

0.786 

0.786 

0.857 

0.857 

0.857 

FAR 

0.024 

0.013 

0.012 

0.032 

0.022 

0.027 

0.032 

Table  C-8.  CDC,  Socorro,  On-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.979 

0.500 

0.990 

0.979 

1.000 

1.000 

1.000 

Pd,  M 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

0.958 

0.000 

1.000 

0.958 

1.000 

1.000 

1.000 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.024 

0.013 

0.012 

0.032 

0.022 

0.027 

0.032 

Table  C-9.  CDC,  Socorro,  Off-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P,,  Total 

0.467 

0.567 

0.267 

0.633 

0.567 

0.500 

0.633 

P, ,  M 

0.688 

1.000 

0.438 

1.000 

1.000 

0.750 

1.000 

P,  LM 

0.214 

0.071 

0.071 

0.214 

0.071 

0.214 

0.214 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.022 

0.007 

0.035 

0.028 

0.037 

0.048 

0.048 

Table  C-10.  CDC,  Socorro,  Off-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P*  Total 

0.889 

0.667 

1.000 

0.889 

1.000 

1.000 

1.000 

Pd,  M 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

0.667 

0.000 

1.000 

0.667 

1.000 

1.000 

1.000 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.022 

0.007 

0.035 

0.028 

0.037 

0.048 

0.048 

Table  C-11.  CDC,  Socorro,  Night,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.807 

0.516 

0.903 

0.839 

0.903 

0.903 

0.903 

Pd,  M 

0.938 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

0.583 

0.000 

0.750 

0.583 

0.750 

0.750 

0.750 

Pd,  NM 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

1.000 

FAR 

0.042 

0.019 

0.026 

0.056 

0.040 

0.049 

0.058 
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Table  C-12.  CDC,  Socorro,  Night,  Surface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.917 

0.500 

1.000 

1.000 

1.000 

1.000 

1.000  ; 

P*  M 

0.833 

1.000 

1.000 

1.000 

1.000 

P*  LM 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

1.000 

P,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.026 

0.056 

0.040 

0.049 

0.058 

3.  Combined  (Aberdeen  and  Socorro) 

Table  C-13.  CDC,  Combined  (Aberdeen  and  Socorro),  On-Road, 
Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-IR 

All  Sensors 

P*  Total 

0.857 

0.596 

0.707 

0.907 

0.864 

0.893 

0.911 

Pd,  M 

0.939 

0.992 

0.735 

1.000 

1.000 

0.977 

1.000 

P«  LM 

0.773 

0.250 

0.656 

0.820 

0.719 

0.805 

0.820 

P,  NM 

0.850 

0.200 

0.850 

0.850 

0.900 

0.900 

0.900 

FAR 

0.032 

0.021 

0.012 

0.042 

0.029 

0.036 

0.043 

Table  C-14.  CDC,  Combined  (Aberdeen  and  Socorro),  On-Road, 
Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

o 

ST 

0.962 

0.560 

0.995 

0.973 

1.000 

1.000 

1.000 

P*  M 

0.976 

1.000 

0.988 

1.000 

1.000 

1.000 

1.000 

1 

CL* 

0.946 

0.185 

1.000 

0.946 

1.000 

1.000 

1.000 

Ptf  NM 

1.000 

0.167 

1.000 

1.000 

1.000 

1.000 

1.000 

FAR 

0.032 

0.021 

0.012 

0.042 

0.029 

0.036 

0.043 

Table  C-15.  CDC,  Combined  (Aberdeen  and  Socorro),  Off-Road, 
Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.786 

0.622 

0.663 

0.847 

0.786 

0.837 

0.878 

Pd,  M 

0.889 

1.000 

0.796 

1.000 

1.000 

0.926 

1.000 

P,  LM 

0.659 

0.159 

0.500 

0.659 

0.523 

0.727 

0.727 

P*  nm 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.037 

0.019 

0.014 

0.045 

0.029 

0.043 

0.049 
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Table  C-16.  CDC,  Combined  (Aberdeen  and  Socorro),  Off-Road, 
Surface,  Pjs  and  FARs 


GPR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.970 

0.621 

1.000 

1.000 

1.000 

Pd,  M 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

0.933 

0.167 

1.000 

0.933 

1.000 

1.000 

1.000 

P„  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.019 

0.014 

0.045 

0.029 

0.043 

0.049 

B.  CRC 
1.  Aberdeen 


Table  C-17.  CRC,  Aberdeen,  On-Road,  Subsurface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.553 

0.477 

0.000 

0.773 

0.477 

0.553 

0.773 

Pd,  M 

1.000 

1.000 

0.532 

1.000 

Pd,  LM 

0.563 

0.016 

0.000 

0.563 

0.016 

0.563 

0.563 

Pd,  NM 

0.667 

0.000 

0.000 

0.667 

0.000 

0.667 

0.667 

FAR 

0.031 

0.003 

0.000 

0.034 

0.003 

0.031 

0.034 

Table  C-18.  CRC,  Aberdeen,  On-Road,  Surface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

Pd,  Total 

0.907 

0.407 

0.000 

0.919 

0.407 

0.907 

0.919 

Pd,  M 

0.972 

0.972 

0.000 

1.000 

0.972 

0.972 

1.000 

Pd,  LM 

0.864 

0.000 

0.000 

0.864 

0.000 

0.864 

0.864 

Pd,  NM 

0.833 

0.000 

0.000 

0.833 

0.000 

0.833 

0.833 

FAR 

0.031 

0.003 

0.000 

0.034 

0.003 

0.031 

0.034 
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Table  C-19.  CRC,  Aberdeen,  Off-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

Pd,  Total 

0.779 

0.588 

0.000 

0.912 

0.912 

0.790 

1.000 

0.000 

1.000 

1.000 

0.790 

1.000 

Pd,  LM 

0.000 

0.800 

0.067 

0.767 

0.800 

P„  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.000 

0.201 

0.018 

0.183 

0.201 

Table  C-20.  CRC,  Aberdeen,  Off-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.896 

0.563 

0.000 

0.958 

0.563 

0.896 

0.958 

P*  M 

0.917 

1.000 

0.000 

1.000 

1.000 

0.917 

1.000 

Pd,  LM 

0.875 

0.125 

0.000 

0.917 

0.125 

0.875 

0.917 

P„  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.183 

0.018 

0.000 

0.201 

0.018 

0.183 

0.201 

Table  C-21.  CRC,  Aberdeen,  Night,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P*  Total 

0.775 

0.450 

0.000 

0.900 

0.450 

0.775 

0.900 

P„  M 

0.722 

1.000 

0.000 

1.000 

1.000 

0.722 

1.000 

P*  lm 

0.800 

0.000 

0.000 

0.800 

0.000 

0.800 

0.800 

P*  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

0.020 

0.002 

0.000 

0.022 

0.002 

0.020 

0.022 

Table  C-22.  CRC,  Aberdeen,  Night,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P„  Total 

1.000 

0.400 

0.000 

1.000 

0.400 

1.000 

1.000 

P„  M 

0.000 

1.000 

1.000 

1.000 

1.000 

P*  LM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

P„  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

FAR 

0.020 

0.002 

0.000 

0.022 

0.002 

0.020 

0.022 
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2.  Socorro 


Table  C-23.  CRC,  Socorro,  On-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.818 

0.473 

0.000 

0.905 

0.473 

0.818 

0.905 

P,  M 

0.814 

1.000 

0.000 

0.814 

1.000 

Pd,  LM 

0.797 

0.000 

0.000 

0.797 

0.000 

0.797 

0.797 

P,  NM 

0.929 

0.000 

0.000 

0.929 

0.000 

0.929 

0.929 

FAR 

0.037 

0.000 

0.000 

0.037 

0.000 

0.037 

0.037 

Table  C-24.  CRC,  Socorro,  On-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.500 

0.000 

1.000 

0.500 

1.000 

1.000 

P,  M 

1.000 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

Pd,  lm 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

P,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.037 

0.000 

0.000 

0.037 

0.000 

0.037 

0.037 

Table  C-25.  CRC,  Socorro,  Off-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

H 

a 

9L 

0.300 

0.533 

0.000 

0.733 

0.533 

0.300 

0.733 

Pd,  M 

0.188 

1.000 

0.000 

1.000 

1.000 

0.188 

1.000 

Pd,  LM 

0.429 

0.000 

0.000 

0.429 

0.000 

0.429 

0.429 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.041 

0.000 

0.000 

0.041 

0.000 

0.041 

0.041 

Table  C-26.  CRC,  Socorro,  Off-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.667 

0.000 

1.000 

0.667 

1.000 

1.000 

Pd,  M 

1.000 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

P„,  LM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.041 

0.000 

0.000 

0.041 

0.000 

0.041 

0.041 
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Table  C-27.  CRC,  Socorro,  Night,  Subsurface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.815 

0.444 

0.000 

0.963 

0.444 

0.815 

0.963 

P*  M 

0.667 

1.000 

0.000 

1.000 

1.000 

0.667 

1.000 

Pd,  LM 

1.000 

0.000 

0.000 

1.000 

1.000 

P,  NM 

0.667 

0.000 

0.000 

0.667 

0.000 

0.667 

0.667 

FAR 

0.000 

0.025 

0.000 

0.025 

0.025 

Table  C-28.  CRC,  Socorro,  Night,  Surface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P„  Total 

1.000 

0.500 

0.000 

1.000 

0.500 

1.000 

1.000 

M 

1.000 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.025 

0.000 

0.000 

0.025 

0.000 

0.025 

0.025 

Table  C-29.  CRC,  Socorro,  Physical-Marking,  EM,  Subsurface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.781 

0.438 

0.000 

1.000 

0.438 

0.781 

1.000 

P„  M 

0.500 

1.000 

0.000 

1.000 

1.000 

0.500 

1.000 

Pd,  LM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

Pd,  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

FAR 

0.037 

0.000 

0.000 

0.037 

0.000 

0.037 

0.037 

Table  C-30.  CRC,  Socorro,  Physical-Marking,  EM,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.500 

0.000 

1.000 

0.500 

1.000 

1.000  ! 

Pd,  M 

1.000 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.037 

0.000 

0.000 

0.037 

0.000 

0.037 

0.037 
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Table  C-31.  CRC,  Socorro,  Morning,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P*  Total 

0.667 

0.444 

0.000 

0.963 

0.444 

0.667 

0.963 

Pd,  M 

0.000 

1.000 

1.000 

0.333 

1.000 

P,  LM 

0.917 

0.917 

Pd,  NM 

1.000 

1.000 

0.000 

1.000 

1.000 

FAR 

0.034 

0.001 

0.000 

0.035 

0.001 

0.034 

0.035 

Table  C-32.  CRC,  Socorro,  Morning,  Surface,  Pjs  and  FARs 


GPR 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pa,  Total 

1.000 

0.500 

0.000 

1.000 

0.500 

1.000 

1.000 

Pd,  M 

1.000 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

LM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

Pdl  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.034 

0.001 

0.000 

0.035 

0.001 

0.034 

0.035 

3.  Combined  (Aberdeen  &  Socorro) 

Table  C-33.  CRC,  Combined  (Aberdeen  and  Socorro),  On-Road, 
Subsurface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.693 

0.475 

0.000 

0.843 

0.475 

0.693 

0.843 

Pd,  M 

0.682 

1.000 

0.000 

1.000 

1.000 

0.682 

1.000 

Pd,  LM 

0.680 

0.008 

0.000 

0.680 

0.008 

0.680 

0.680 

P,  NM 

0.850 

0.000 

0.000 

0.850 

0.000 

0.850 

0.850 

FAR 

0.034 

0.002 

0.000 

0.035 

0.002 

0.034 

0.035 

Table  C-34.  CRC,  Combined  (Aberdeen  and  Socorro),  On-Road, 
Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.956 

0.456 

0.000 

0.962 

0.456 

0.956 

0.962 

P«  M 

0.988 

0.988 

0.000 

1.000 

0.988 

0.988 

1.000 

Pd,  LM 

0.935 

0.000 

0.000 

0.935 

0.000 

0.935 

0.935 

Pd,  NM 

0.833 

0.000 

0.000 

0.833 

0.000 

0.833 

0.833 

FAR 

0.034 

0.002 

0.000 

0.035 

0.002 

0.034 

0.035 
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Table  C-3S.  CRC,  Combined  (Aberdeen  and  Socorro),  Off-Road, 
Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

All  Sensors 

Pd,  Total 

0.633 

0.571 

0.000 

0.857 

0.571 

0.633 

0.857 

P„,  M 

0.611 

1.000 

0.000 

1.000 

1.000 

0.611 

1.000 

P*  LM 

0.659 

0.046 

0.000 

0.682 

0.046 

0.659 

0.682 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.000 

0.171 

0.015 

0.156 

0.171 

Table  C-36.  CRC,  Combined  (Aberdeen  and  Socorro),  Off-Road, 
Surface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.924 

0.591 

0.000 

0.970 

0.591 

0.924 

0.970 

Pd,  M 

0.944 

1.000 

0.000 

1.000 

1.000 

0.944 

1.000 

lm 

0.900 

0.100 

0.000 

0.933 

0.100 

0.900 

0.933 

P„  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.000 

0.171 

0.015 

0.156 

0.171 

C.  EG&G 
1.  Aberdeen 

Table  C-37.  EG&G,  Aberdeen,  On-Road,  Subsurface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.697 

0.470 

0.621 

0.727 

0.856 

0.924 

0.932 

P„  M 

0.936 

1.000 

0.500 

1.000 

1.000 

0.984 

1.000 

Pd,  LM 

0.484 

0.000 

0.703 

0.484 

0.703 

0.859 

0.859 

0.500 

0.000 

1.000 

0.500 

1.000 

1.000 

1.000 

FAR 

0.036 

0.000 

0.047 

0.036 

0.047 

0.081 

0.081 

C-13 


Table  C-38.  EG&G,  Aberdeen,  On-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.977 

0.884 

1.000 

1.000 

WEMM 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

0.977 

0.000 

0.773 

0.977 

0.773 

1.000 

1.000 

Pd,  NM 

0.833 

0.000 

1.000 

0.833 

1.000 

1.000 

1.000 

FAR 

0.036 

0.000 

0.047 

0.036 

0.047 

0.081 

0.081 

Table  C-39.  EG&G,  Aberdeen,  Off-Road,  Subsurface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.794 

0.559 

0.456 

0.897 

0.779 

0.868 

0.956 

P*  M 

0.816 

1.000 

0.421 

1.000 

1.000 

0.842 

1.000 

Pd,  LM 

0.767 

0.000 

0.500 

0.767 

0.500 

0.900 

0.900 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.078 

0.004 

0.020 

0.081 

0.023 

0.095 

0.099 

Table  C-40.  EG&G,  Aberdeen,  Off-Road,  Surface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.938 

0.500 

0.896 

0.938 

0.917 

0.958 

0.958 

Pd,  M 

1.000 

1.000 

0.958 

1.000 

1.000 

1.000 

1.000 

P ,  LM 

0.875 

0.000 

0.833 

0.875 

0.833 

0.917 

0.917 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.078 

0.004 

0.020 

0.081 

0.023 

0.095 

0.099 

Table  C-41.  EG&G,  Aberdeen,  Night,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.717 

0.478 

0.022 

0.739 

0.478 

0.717 

0.739 

Pd,  M 

0.046 

1.000 

1.000 

0.955 

1.000 

Pd,  LM 

0.000 

0.500 

0.000 

0.500 

0.500 

Pd,  NM 

0.500 

0.000 

0.000 

0.500 

0.000 

0.500 

0.500 

FAR 

0.129 

0.000 

0.014 

0.129 

0.014 

0.143 

0.143 

C-14 


Table  C-42.  EG&G,  Aberdeen,  Night,  Surface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

Pd,  Total 

1.000 

0.429 

0.393 

1.000 

0.607 

1.000 

1.000 

Pd,  M 

1.000 

1.000 

0.500 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

1.000 

0.000 

0.286 

1.000 

0.286 

1.000 

1.000 

Pd,  NM 

1.000 

0.000 

0.500 

1.000 

0.500 

1.000 

1.000 

FAR 

0.129 

0.000 

0.014 

0.129 

0.014 

0.143 

0.143 

Table  C-43.  EG&G,  Aberdeen,  Physical-Marking,  EM,  Subsurface, 

Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P„  Total 

0.550 

0.450 

0.350 

0.600 

0.650 

0.700 

0.750 

Pd,  M 

0.889 

1.000 

0.333 

1.000 

1.000 

0.889 

1.000 

P«  LM 

0.300 

0.000 

0.400 

0.300 

0.400 

0.600 

0.600 

P„  NM 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

FAR 

0.005 

0.005 

0.035 

0.039 

0.039 

Table  C-44.  EG&G,  Aberdeen,  Physical-Marking,  EM,  Surface, 

Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

P*  Total 

0.933 

0.400 

1.000 

0.933 

1.000 

1.000 

1.000 

P*  M 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

P „  lm 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

1.000 

P*  NM 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

1.000 

FAR 

0.005 

0.000 

0.035 

0.005 

0.035 

0.039 

0.039 

2.  Socorro 


Table  C-45.  EG&G,  Socorro,  On-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.905 

0.466 

0.243 

0.905 

0.601 

0.919 

0.919 

P„  M 

1.000 

0.971 

0.229 

1.000 

0.971 

1.000 

1.000 

Pd,  LM 

0.797 

0.016 

0.234 

0.797 

0.250 

0.828 

0.828 

P,  NM 

0.929 

0.000 

0.357 

0.929 

0.357 

0.929 

0.929 

FAR 

0.036 

0.037 

0.008 

0.042 

0.043 
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Table  C-46.  EG&G,  Socorro,  On-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

0.969 

0.479 

0.802 

0.969 

0.865 

0.969 

0.969 

P*  M 

0.958 

0.958 

0.833 

0.958 

0.958 

0.958 

Pd,  LM 

0.979 

0.000 

0.771 

0.979 

0.771 

0.979 

0.979 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.036 

0.001 

0.007 

0.037 

0.008 

0.042 

0.043 

Table  C-47.  EG&G,  Socorro,  Off-Road,  Subsurface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.600 

0.533 

0.100 

0.700 

0.533 

0.633 

0.700 

P*  M 

0.813 

1.000 

0.188 

1.000 

1.000 

0.875 

1.000 

P,  LM 

0.357 

0.000 

0.000 

0.357 

0.000 

0.357 

0.357 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.041 

0.000 

0.019 

0.041 

0.019 

0.058 

0.058 

Table  C-48.  EG&G,  Socorro,  Off-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.667 

0.889 

1.000 

1.000 

1.000 

1.000 

P*  M 

1.000 

1.000 

0.833 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

1.000 

P„  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.041 

0.000 

0.019 

0.041 

0.019 

0.058 

0.058 

Table  C-49.  EG&G,  Socorro,  Night,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.889 

0.444 

0.185 

0.889 

0.556 

0.889 

0.889 

P,  M 

1.000 

1.000 

0.167 

1.000 

1.000 

1.000 

1.000 

Pd>  LM 

0.833 

0.000 

0.250 

0.833 

0.250 

0.833 

0.833 

P„  NM 

0.667 

0.000 

0.000 

0.667 

0.000 

0.667 

0.667 

FAR 

0.019 

0.000 

0.009 

0.019 

0.009 

0.028 

0.028 

C-16 


Table  C-50.  EG&G,  Socorro,  Night,  Surface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

Pd,  Total 

1.000 

0.500 

1.000 

1.000 

1.000 

1.000 

1.000 

P*  M 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

Pai  LM 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.009 

0.019 

0.009 

0.028 

0.028 

Table  C-51.  EG&G,  Socorro,  Physical-Marking,  EM,  Subsurface, 

Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.963 

0.444 

0.704 

0.963 

0.852 

1.000 

1.000 

Pd,  M 

1.000 

1.000 

0.667 

1.000 

1.000 

1.000 

1.000 

P ,  LM 

0.917 

0.000 

0.750 

0.917 

0.750 

1.000 

1.000 

P„  NM 

1.000 

0.000 

0.667 

1.000 

0.667 

1.000 

1.000 

FAR 

0.031 

0.000 

0.103 

0.031 

0.103 

0.128 

0.128 

Table  C-52.  EG&G,  Socorro,  Physical-Marking,  EM,  Surface, 

Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.500 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  M 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

P*  lm 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

1.000 

Ptf  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.031 

0.000 

0.103 

0.031 

0.103 

0.128 

0.128 

Table  C-53.  EG&G,  Socorro,  Tele-operated,  Subsurface, 
Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P„  Total 

0.963 

0.444 

0.333 

0.963 

0.667 

0.963 

0.963 

P„  M 

1.000 

1.000 

0.250 

1.000 

1.000 

1.000 

1.000 

P*  lm 

0.917 

0.000 

0.333 

0.917 

0.333 

0.917 

0.917 

P*  NM 

1.000 

0.000 

0.667 

1.000 

0.667 

1.000 

1.000 

FAR 

0.038 

0.000 

0.025 

0.038 

0.025 

0.063 

0.063 

C-17 


Table  C-54.  EG&G,  Socorro,  Tele-operated,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

1.000 

0.889 

1.000 

1.000 

P*  M 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

P„  LM 

1.000 

0.000 

0.778 

1.000 

0.778 

1.000 

1.000 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.038 

0.000 

0.025 

0.038 

0.025 

0.063 

0.063 

3.  Combined  (Aberdeen  &  Socorro) 

Table  C-55.  EG&G,  Combined  (Aberdeen  and  Socorro),  On-Road, 
Subsurface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

P*  Total 

0.807 

0.468 

0.421 

0.821 

0.721 

0.925 

0.985 

0.356 

1.000 

0.985 

0.992 

1.000 

P„  LM 

0.641 

0.008 

0.469 

0.641 

0.477 

0.844 

0.844 

P„  NM 

0.800 

0.000 

0.550 

0.800 

0.550 

0.950 

0.950 

FAR 

0.036 

0.001 

0.027 

0.036 

0.028 

0.062 

0.062 

Table  C-56.  EG&G,  Combined  (Aberdeen  and  Socorro),  On-Road, 
Surface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.973 

0.451 

0.791 

0.973 

0.874 

0.984 

0.984 

P*  M 

0.976 

0.976 

0.798 

0.976 

0.976 

0.976 

0.976 

Pd,  LM 

0.978 

0.000 

0.772 

0.978 

0.772 

0.989 

0.989 

Pd,  NM 

0.833 

0.000 

1.000 

0.833 

1.000 

1.000 

1.000 

FAR 

0.036 

0.001 

0.027 

0.036 

0.028 

0.062 

0.062 

Table  C-57.  EG&G,  Combined  (Aberdeen  and  Socorro),  Off-Road, 
Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.735 

0.551 

0.347 

0.837 

0.704 

0.796 

0.878 

Pd,  M 

0.815 

1.000 

0.352 

1.000 

1.000 

0.852 

1.000 

Pd,  LM 

0.636 

0.000 

0.341 

0.636 

0.341 

0.727 

0.727 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.071 

0.003 

0.020 

0.073 

0.022 

0.088 

0.091 

C-18 


Table  C-58.  EG&G,  Combined  (Aberdeen  and  Socorro)  Off-Road, 
Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.955 

0.546 

0.894 

0.955 

0.939 

0.970 

0.970 

Pd,  M 

1.000 

1.000 

0.917 

1.000 

1.000 

1.000 

1.000 

P*  LM 

0.867 

0.900 

0.867 

0.933 

0.933 

P*  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.071 

0.003 

0.020 

0.073 

0.022 

0.088 

0.091 

D.  GDE 
1.  Aberdeen 


Table  C-59.  GDE,  Aberdeen,  On-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.871 

0.439 

0.000 

0.909 

0.439 

0.871 

0.909 

P,  M 

0.871 

0.936 

0.000 

0.952 

0.936 

0.871 

0.952 

P*  LM 

0.906 

0.000 

0.000 

0.906 

0.000 

0.906 

0.906 

Pd,  NM 

0.500 

0.000 

0.000 

0.500 

0.000 

0.500 

0.500 

FAR 

0.067 

0.002 

0.000 

0.068 

0.002 

0.067 

0.068 

Table  C-60.  GDE,  Aberdeen,  On-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P„  Total 

0.919 

0.407 

0.000 

0.965 

0.407 

0.919 

0.965 

Pd,  M 

0.861 

0.972 

0.000 

0.972 

0.972 

0.861 

0.972 

P*  LM 

0.955 

0.000 

0.000 

0.955 

0.000 

0.955 

0.955 

P«  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

FAR 

0.067 

0.002 

0.000 

0.068 

0.002 

0.067 

0.068 

C-19 


Table  C-61.  GDE,  Aberdeen,  Off-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.618 

0.632 

0.838 

0.912 

Pd,  M 

0.658 

0.895 

1.000 

Pd,  LM 

0.567 

0.167 

0.367 

0.600 

0.467 

0.767 

0.800 

P,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.063 

0.018 

0.012 

0.079 

0.029 

0.070 

0.085 

Table  C-62.  GDE,  Aberdeen,  Off-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.771 

0.563 

0.625 

0.854 

0.938 

P«  M 

0.708 

1.000 

0.667 

1.000 

1.000 

0.833 

1.000 

P„  LM 

0.833 

0.125 

0.583 

0.833 

0.667 

0.875 

0.875 

P,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.063 

0.018 

0.012 

0.079 

0.029 

0.070 

0.085 

Table  C-63.  GDE,  Aberdeen,  Night,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.478 

0.000 

1.000 

0.478 

1.000 

1.000 

Pd,  M 

0.000 

1.000 

1.000 

1.000 

1.000 

P, ,  lm 

0.000 

1.000 

0.000 

1.000 

1.000 

Pd,  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

FAR 

0.012 

0.002 

0.000 

0.015 

0.002 

0.012 

0.015 

Table  C-64.  GDE,  Aberdeen,  Night,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.429 

0.250 

1.000 

0.571 

1.000 

1.000 

P,  M 

1.000 

1.000 

0.250 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

1.000 

0.000 

0.214 

1.000 

0.214 

1.000 

1.000 

Pd,  NM 

1.000 

0.000 

0.500 

1.000 

0.500 

1.000 

1.000 

FAR 

0.012 

0.002 

0.000 

0.015 

0.002 

0.012 

0.015 
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2.  Socorro 


Table  C-65.  GDE,  Socorro,  On-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.885 

0.480 

0.000 

0.899 

0.480 

0.885 

0.899 

P*  M 

0.971 

1.000 

0.000 

1.000 

1.000 

0.971 

1.000 

Pd,  LM 

0.766 

0.016 

0.000 

0.766 

0.016 

0.766 

0.766 

Pd,  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

FAR 

0.033 

0.002 

0.003 

0.035 

0.004 

0.036 

0.037 

Table  C-66.  GDE,  Socorro,  On-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.490 

0.208 

1.000 

0.594 

1.000 

1.000 

Pd,  M 

1.000 

0.979 

0.208 

1.000 

0.979 

1.000 

1.000 

Pd,  LM 

1.000 

0.000 

0.208 

1.000 

0.208 

1.000 

1.000 

P„  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.033 

0.002 

0.003 

0.035 

0.004 

0.036 

0.037 

Table  C-67.  GDE,  Socorro,  Off-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P„  Total 

0.800 

0.533 

0.000 

0.800 

0.533 

0.800 

0.800 

Pd,  M 

1.000 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

0.571 

0.000 

0.000 

0.571 

0.000 

0.571 

0.571 

NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.063 

0.002 

0.000 

0.065 

0.002 

0.063 

0.065 

Table  C-68.  GDE,  Socorro,  Off-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.667 

0.222 

1.000 

0.722 

1.000 

1.000 

Pd,  M 

1.000 

1.000 

0.250 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

1.000 

0.000 

0.167 

1.000 

0.167 

1.000 

1.000 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.063 

0.002 

0.000 

0.065 

0.002 

0.063 

0.065 
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Table  C-69.  GDE,  Socorro,  Night,  Subsurface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pa,  Total 

0.875 

0.438 

0.000 

0.906 

0.438 

0.875 

0.906 

P*  M 

1.000 

1.000 

0.929 

1.000 

i— 

0.000 

0.875 

0.000 

0.875 

0.875 

Pd,  NM 

0.500 

0.000 

0.000 

0.500 

0.000 

0.500 

0.500 

FAR 

0.014 

0.002 

0.000 

0.016 

0.002 

0.014 

0.016 

Table  C-70.  GDE,  Socorro  Night,  Surface,  P„ s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P,  Total 

1.000 

0.500 

0.500 

1.000 

0.563 

1.000 

1.000 

P, „  M 

1.000 

1.000 

0.875 

1.000 

1.000 

1.000 

1.000 

P„  LM 

1.000 

0.000 

0.125 

1.000 

0.125 

1.000 

1.000 

P„  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.014 

0.002 

0.000 

0.016 

0.002 

0.014 

0.016 

Table  C-71.  GDE,  Socorro,  Physical-Marking,  EM,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.938 

0.438 

0.000 

0.938 

0.438 

0.938 

0.938 

P*  M 

1.000 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

P«  LM 

0.875 

0.000 

0.000 

0.875 

0.000 

0.875 

0.875 

P„  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

FAR 

0.027 

0.000 

0.000 

0.027 

0.000 

0.027 

0.027 

Table  C-72.  GDE,  Socorro,  Physical-Marking,  EM,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

1.000 

0.500 

1.000 

1.000 

Pd,  M 

1.000 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

P,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.027 

0.000 

0.000 

0.027 

0.000 

0.027 

0.027 
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Table  C-73.  GDE,  Socorro,  Morning,  Subsurface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.944 

0.444 

0.000 

1.000 

0.444 

0.944 

1.000 

P,  M 

0.875 

1.000 

0.000 

1.000 

1.000 

0.875 

1.000 

P*  LM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

P„  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

FAR 

0.008 

0.000 

0.000 

0.008 

0.000 

0.008 

0.008 

Table  C-74.  GDE,  Socorro,  Morning,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P*  Total 

1.000 

0.500 

0.000 

1.000 

0.500 

1.000 

1.000 

P*  M 

1.000 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

P.  lm 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

P„  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.008 

0.000 

0.000 

0.008 

0.000 

0.008 

0.008 

3.  Combined  (Aberdeen  and  Socorro) 

Table  C-75.  GDE,  Combined  (Aberdeen  and  Socorro),  On-Road, 
Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P„  Total 

0.879 

0.461 

0.000 

0.904 

0.461 

0.879 

0.904 

P.  M 

0.924 

0.970 

0.000 

0.977 

0.970 

0.924 

0.977 

P ,  LM 

0.836 

0.008 

0.000 

0.836 

0.008 

0.836 

0.836 

P„  NM 

0.850 

0.000 

0.000 

0.850 

0.000 

0.850 

0.850 

FAR 

0.050 

0.002 

0.001 

0.051 

0.003 

0.051 

0.053 

Table  C-76.  GDE,  Combined  (Aberdeen  and  Socorro),  On-Road, 
Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.962 

0.451 

0.110 

0.984 

0.506 

0.962 

0.984 

P„  M 

0.941 

0.976 

0.119 

0.988 

0.976 

0.941 

0.988 

P „  lm 

0.978 

0.000 

0.109 

0.978 

0.109 

0.978 

0.978 

P*  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

FAR 

0.050 

0.002 

0.001 

0.051 

0.003 

0.051 

0.053 
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Table  C-77.  GDE,  Combined  (Aberdeen  and  Socorro),  Off-Road, 
Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.674 

0.602 

0.286 

0.816 

0.694 

0.827 

0.878 

Pa,  M 

0.759 

1.000 

0.315 

1.000 

1.000 

0.926 

1.000 

Pd,  LM 

0.568 

0.114 

0.250 

0.591 

0.318 

0.705 

0.727 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.063 

0.015 

0.010 

0.076 

0.024 

0.069 

0.081 

Table  C-78.  GDE,  Combined  (Aberdeen  and  Socorro),  Off-Road, 
Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.833 

0.591 

0.515 

0.939 

0.803 

0.894 

0.955 

P«  M 

0.806 

1.000 

0.528 

1.000 

1.000 

0.889 

1.000 

P,  LM 

0.867 

0.100 

0.500 

0.867 

0.567 

0.900 

0.900 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.063 

0.015 

0.010 

0.076 

0.024 

0.069 

0.081 

E.  GEOCENTERS 
1.  Aberdeen 

Table  C-79.  GeoC,  Aberdeen,  On-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

All  Sensors 

Pd,  Total 

0.977 

0.447 

0.000 

0.985 

0.447 

0.977 

0.985 

P*  M 

1.000 

0.936 

0.000 

1.000 

0.936 

1.000 

1.000 

P*  LM 

0.953 

0.016 

0.000 

0.969 

0.016 

0.953 

0.969 

P,  nm 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

FAR 

0.048 

0.008 

0.000 

0.056 

0.008 

0.048 

0.056 
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Table  C-80.  GeoC,  Aberdeen,  On-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

Pd,  Total 

0.965 

0.430 

0.988 

1.000 

0.988 

1.000 

1.000 

P„  M 

0.917 

0.972 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

1.000 

0.046 

0.977 

1.000 

0.977 

1.000 

1.000 

P„,  NM 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

1.000 

FAR 

0.048 

0.008 

0.000 

0.056 

0.008 

0.048 

0.056 

Table  C-81.  GeoC,  Aberdeen,  Off-Road,  Subsurface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P*  Total 

0.897 

0.441 

0.000 

0.897 

0.441 

0.897 

0.897 

P, „  M 

1.000 

0.790 

0.000 

1.000 

0.790 

1.000 

1.000 

P*  lm 

0.767 

0.000 

0.000 

0.767 

0.000 

0.767 

0.767 

P„  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.065 

0.001 

0.000 

0.066 

0.001 

0.065 

0.066 

Table  C-82.  GeoC,  Aberdeen,  Off-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P„  Total 

0.979 

0.479 

1.000 

0.979 

1.000 

1.000 

1.000 

P«  M 

1.000 

0.958 

1.000 

1.000 

1.000 

1.000 

1.000 

P*  lm 

0.958 

0.000 

1.000 

0.958 

1.000 

1.000 

1.000 

P*  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.065 

0.001 

0.000 

0.066 

0.001 

0.065 

0.066 

Table  C-83.  GeoC,  Aberdeen,  Night,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P„  Total 

1.000 

0.478 

0.000 

1.000 

0.478 

1.000 

1.000 

P„  M 

1.000 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

p*  LM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

P,  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

FAR 

0.033 

0.000 

0.000 

0.033 

0.000 

0.033 

0.033 
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Table  C-84.  GeoC,  Aberdeen,  Night,  Surface,  Pjs  and  FARs 


GPR 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.393 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

1.000 

1.000 

1.000 

1.000 

1.000 

P„  NM 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

1.000 

FAR 

0.033 

0.000 

0.000 

0.033 

0.000 

0.033 

0.033 

Table  C-85.  GeoC,  Aberdeen,  Physical-Marking,  EM,  Subsurface, 

Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P„  Total 

0.913 

0.478 

0.000 

0.913 

0.478 

0.913 

0.913 

P„,  M 

1.000 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

P„  LM 

0.818 

0.000 

0.000 

0.818 

0.000 

0.818 

0.818 

P„,  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

FAR 

0.037 

0.002 

0.004 

0.038 

0.005 

0.040 

0.042 

Table  C-86.  GeoC,  Aberdeen,  Physical-Marking,  EM,  Surface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.286 

0.714 

1.000 

0.857 

1.000 

1.000 

P, ,  M 

1.000 

0.667 

0.667 

1.000 

1.000 

1.000 

1.000 

P„  lm 

1.000 

0.000 

0.714 

1.000 

0.714 

1.000 

1.000 

P„,  NM 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

1.000 

FAR 

0.037 

0.002 

0.004 

0.038 

0.005 

0.040 

0.042 

Table  C-87.  GeoC,  Aberdeen,  Tele-operated,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.478 

0.000 

1.000 

0.478 

1.000 

1.000 

P*  M 

0.000 

1.000 

1.000 

1.000 

1.000 

P„  lm 

0.000 

1.000 

0.000 

1.000 

1.000 

P„  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

FAR 

0.013 

0.002 

0.000 

0.015 

0.002 

0.013 

0.015 
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Table  C-88.  GeoC,  Aberdeen,  Tele-operated,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.357 

0.000 

1.000 

0.357 

1.000 

1.000 

P,  M 

1.000 

0.833 

0.000 

1.000 

0.833 

1.000 

1.000 

P«  LM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

Pd,  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

FAR 

0.013 

0.002 

0.000 

0.015 

0.002 

0.013 

0.015 

2.  Socorro 


Table  C-89.  GeoC,  Socorro,  On-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.912 

0.473 

0.176 

0.912 

0.595 

0.912 

0.912 

P»  M 

1.000 

1.000 

0.114 

1.000 

1.000 

1.000 

1.000 

P„,  LM 

0.859 

0.000 

0.266 

0.859 

0.266 

0.859 

0.859 

Pd,  NM 

0.714 

0.000 

0.071 

0.714 

0.071 

0.714 

0.714 

FAR 

0.032 

0.000 

0.000 

0.032 

0.001 

0.032 

0.032 

Table  C-90.  GeoC,  Socorro,  On-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.500 

0.833 

1.000 

0.917 

1.000 

1.000 

P«  M 

1.000 

1.000 

0.833 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

1.000 

0.000 

0.833 

1.000 

0.833 

1.000 

1.000 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.032 

0.000 

0.000 

0.032 

0.001 

0.032 

0.032 

Table  C-91.  GeoC,  Socorro,  Off-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.700 

0.533 

0.000 

0.700 

0.533 

0.700 

0.700 

Pd,  M 

1.000 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

Ptf,  LM 

0.357 

0.000 

0.000 

0.357 

0.000 

0.357 

0.357 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.035 

0.000 

0.000 

0.035 

0.000 

0.035 

0.035 
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Table  C-92.  GeoC,  Socorro  Off-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.667 

0.944 

1.000 

0.944 

1.000 

1.000 

P„  M 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

1.000 

0.000 

0.833 

1.000 

0.833 

1.000 

1.000 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.035 

0.000 

0.000 

0.035 

0.000 

0.035 

0.035 

Table  C-93.  GeoC,  Socorro,  Night,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

All  Sensors 

P„  Total 

0.807 

0.516 

0.000 

0.839 

0.516 

0.807 

0.839 

P,  M 

0.938 

1.000 

0.000 

1.000 

1.000 

P*  LM 

0.667 

0.000 

0.000 

0.667 

0.000 

0.667 

0.667 

Pd>  NM 

0.667 

0.000 

0.000 

0.667 

0.000 

0.667 

0.667 

FAR 

0.000 

0.029 

0.000 

0.029 

0.029 

Table  C-94.  GeoC,  Socorro,  Night,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

1.000 

0.476 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  M 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

LM 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

1.000 

P„  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.029 

0.000 

0.000 

0.029 

0.000 

0.029 

0.029 

Table  C-95.  GeoC,  Socorro,  Physical-Marking,  EM,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.875 

0.438 

0.125 

0.906 

0.531 

0.875 

0.906 

Pd,  M 

0.929 

1.000 

0.071 

1.000 

1.000 

0.929 

1.000 

P,  LM 

0.875 

0.000 

0.188 

0.875 

0.188 

0.875 

0.875 

Pd,  NM 

0.500 

0.000 

0.000 

0.500 

0.000 

0.500 

0.500 

FAR 

0.027 

0.000 

0.000 

0.027 

0.000 
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Table  C-96.  GeoC,  Socorro,  Physical-Marking,  EM,  Surface,  Pd s  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Tota 

1.000 

0.500 

1.000 

1.000 

1.000 

P,  M 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

1.000 

Pd,  LM 

1.000 

1.000 

1.000 

1.000 

1.000 

P„  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.027 

0.000 

0.000 

0.027 

0.000 

0.027 

0.027 

Table  C-97.  GeoC,  Socorro,  Tele-operated,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pa,  Total 

0.844 

0.438 

0.000 

0.906 

0.438 

0.844 

0.906 

P„  M 

0.857 

1.000 

0.000 

1.000 

1.000 

0.857 

1.000 

Pa,  LM 

0.813 

0.000 

0.000 

0.813 

0.000 

0.813 

0.813 

P„  NM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

FAR 

0.019 

0.000 

0.000 

0.019 

0.000 

0.019 

0.019 

Table  C-98.  GeoC,  Socorro,  Tele-operated,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P&  Total 

1.000 

0.500 

0.000 

1.000 

0.500 

1.000 

1.000 

P„  M 

1.000 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

P„  LM 

1.000 

0.000 

0.000 

1.000 

0.000 

1.000 

1.000 

P„  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.019 

0.000 

0.000 

0.019 

0.000 

0.019 

0.019 

3.  Combined  (Aberdeen  &  Socorro) 

Table  C-99.  GeoC,  Combined  (Aberdeen  and  Socorro), 
On-Road,  Subsurface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

P„  Total 

0.943 

0.461 

0.093 

0.946 

0.525 

0.943 

0.946 

P„  M 

1.000 

0.970 

0.061 

1.000 

0.970 

1.000 

1.000 

P,  lm 

0.906 

0.008 

0.133 

0.914 

0.141 

0.906 

0.914 

Pdl  NM 

0.800 

0.000 

0.050 

0.800 

0.050 

0.800 

0.800 

FAR 

0.040 

0.004 

0.000 

0.044 

0.004 

0.040 

0.044 
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Table  C-100.  GeoC,  Combined  (Aberdeen  and  Socorro), 
On-Road,  Surface,  Pd s  and  FARs 


GPR 

EMI 

IR 

All  Sensors 

Pd,  Total 

0.984 

0.467 

0.907 

1.000 

0.951 

1.000 

1.000 

P*  M 

0.964 

0.988 

0.905 

1.000 

1.000 

1.000 

1.000 

P,  LM 

1.000 

0.022 

0.902 

1.000 

0.902 

1.000 

1.000 

Pd,  NM 

1.000 

0.000 

1.000 

1.000 

1.000 

1.000 

1.000 

FAR 

0.040 

0.004 

0.000 

0.044 

0.004 

0.040 

0.044 

Table  C-101.  GeoC,  Combined  (Aberdeen  and  Socorro), 
Off-Road,  Subsurface,  Pd s  and  FARs  ,  CRC 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pd,  Total 

0.837 

0.469 

0.000 

0.837 

0.469 

0.837 

0.837 

Pd,  M 

1.000 

0.852 

0.000 

1.000 

0.852 

1.000 

1.000 

LM 

0.636 

0.000 

0.000 

0.636 

0.000 

0.636 

0.636 

P„  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.059 

0.001 

0.000 

0.060 

0.001 

0.059 

0.060 

Table  C-102.  GeoC,  Combined  (Aberdeen  and  Socorro) 
Off-Road,  Surface,  Pjs  and  FARs 


GPR 

EMI 

IR 

GPR-EMI 

EMI-IR 

GPR-IR 

All  Sensors 

Pdl  Total 

0.985 

0.530 

0.985 

0.985 

0.985 

1.000 

1.000 

Pd,  M 

1.000 

0.972 

1.000 

1.000 

1.000 

1.000 

1.000 

P*  LM 

0.967 

0.000 

0.967 

0.967 

0.967 

1.000 

1.000 

Pd,  NM 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

FAR 

0.059 

0.001 

0.000 

0.060 

0.001 

0.059 

0.060 
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